-- Logs begin at Tue 2022-05-10 20:11:25 UTC, end at Tue 2022-05-10 21:42:45 UTC. -- May 10 21:10:51.134666 dv-cinder-836083-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 10 21:10:51.143333 dv-cinder-836083-6-iscsi devstack@n-api.service[103312]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 10 21:10:51.145994 dv-cinder-836083-6-iscsi devstack@n-api.service[103312]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 21:10:51 2022] *** May 10 21:10:51.145994 dv-cinder-836083-6-iscsi devstack@n-api.service[103312]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 21:10:51.145994 dv-cinder-836083-6-iscsi devstack@n-api.service[103312]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 21:10:51.145994 dv-cinder-836083-6-iscsi devstack@n-api.service[103312]: nodename: dv-cinder-836083-6-iscsi May 10 21:10:51.145994 dv-cinder-836083-6-iscsi devstack@n-api.service[103312]: machine: x86_64 May 10 21:10:51.145994 dv-cinder-836083-6-iscsi devstack@n-api.service[103312]: clock source: unix May 10 21:10:51.145994 dv-cinder-836083-6-iscsi devstack@n-api.service[103312]: pcre jit disabled May 10 21:10:51.145994 dv-cinder-836083-6-iscsi devstack@n-api.service[103312]: detected number of CPU cores: 4 May 10 21:10:51.145994 dv-cinder-836083-6-iscsi devstack@n-api.service[103312]: current working directory: / May 10 21:10:51.145994 dv-cinder-836083-6-iscsi devstack@n-api.service[103312]: detected binary path: /usr/bin/uwsgi-core May 10 21:10:51.146741 dv-cinder-836083-6-iscsi devstack@n-api.service[103312]: your processes number limit is 47680 May 10 21:10:51.146741 dv-cinder-836083-6-iscsi devstack@n-api.service[103312]: your memory page size is 4096 bytes May 10 21:10:51.146741 dv-cinder-836083-6-iscsi devstack@n-api.service[103312]: detected max file descriptor number: 2048 May 10 21:10:51.146741 dv-cinder-836083-6-iscsi devstack@n-api.service[103312]: lock engine: pthread robust mutexes May 10 21:10:51.146741 dv-cinder-836083-6-iscsi devstack@n-api.service[103312]: thunder lock: enabled May 10 21:10:51.146741 dv-cinder-836083-6-iscsi devstack@n-api.service[103312]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 10 21:10:51.146741 dv-cinder-836083-6-iscsi devstack@n-api.service[103312]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 21:10:51.192270 dv-cinder-836083-6-iscsi devstack@n-api.service[103312]: Python main interpreter initialized at 0x5602515819c0 May 10 21:10:51.192270 dv-cinder-836083-6-iscsi devstack@n-api.service[103312]: python threads support enabled May 10 21:10:51.192270 dv-cinder-836083-6-iscsi devstack@n-api.service[103312]: your server socket listen backlog is limited to 100 connections May 10 21:10:51.192270 dv-cinder-836083-6-iscsi devstack@n-api.service[103312]: your mercy for graceful operations on workers is 90 seconds May 10 21:10:51.192588 dv-cinder-836083-6-iscsi devstack@n-api.service[103312]: mapped 403077 bytes (393 KB) for 2 cores May 10 21:10:51.192670 dv-cinder-836083-6-iscsi devstack@n-api.service[103312]: *** Operational MODE: preforking *** May 10 21:10:51.192930 dv-cinder-836083-6-iscsi devstack@n-api.service[103312]: *** uWSGI is running in multiple interpreter mode *** May 10 21:10:51.192930 dv-cinder-836083-6-iscsi devstack@n-api.service[103312]: spawned uWSGI master process (pid: 103312) May 10 21:10:51.193112 dv-cinder-836083-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 10 21:10:51.194567 dv-cinder-836083-6-iscsi devstack@n-api.service[103312]: spawned uWSGI worker 1 (pid: 103313, cores: 1) May 10 21:10:51.194567 dv-cinder-836083-6-iscsi devstack@n-api.service[103312]: spawned uWSGI worker 2 (pid: 103314, cores: 1) May 10 21:10:51.194567 dv-cinder-836083-6-iscsi devstack@n-api.service[103312]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 21:10:52.392257 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 21:10:52.407110 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 21:10:53.124460 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 21:10:53.124460 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: from cryptography.utils import int_from_bytes May 10 21:10:53.124783 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 21:10:53.124783 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: from cryptography.utils import int_from_bytes May 10 21:10:53.127496 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 21:10:53.127496 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: from cryptography.utils import int_from_bytes May 10 21:10:53.127829 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 21:10:53.127829 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: from cryptography.utils import int_from_bytes May 10 21:10:55.728670 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 21:10:55.729333 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 21:10:55.729680 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 21:10:55.729765 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 21:10:55.729849 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 21:10:55.729918 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 21:10:55.729993 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 21:10:55.730063 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 21:10:55.730135 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 21:10:55.730210 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 21:10:55.730429 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.730563 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.730781 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.730880 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.731105 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.731210 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.731427 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.731515 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.731762 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.731856 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.732078 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.732165 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.732397 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.732490 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.732713 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.732804 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.733037 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.733124 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.733296 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.733382 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.733607 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.733703 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.733929 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836083-6-iscsi {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.734038 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836083-6-iscsi {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.734251 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.734347 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.734581 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.734687 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.734890 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.734980 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.735208 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.735300 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.735509 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.735608 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.735828 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.735920 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.736136 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.736219 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.736627 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.736736 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.738156 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.738353 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.738353 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.738783 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.738783 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.739016 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.739146 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.739269 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.739497 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.739635 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.739765 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.739893 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.740015 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.740135 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.740257 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.740385 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.740385 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.740613 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.740613 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.740870 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.741006 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836083-6-iscsi {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.741137 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836083-6-iscsi {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.741269 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.741402 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.741530 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.741651 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.741780 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.741911 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.742040 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.742184 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.742306 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.742429 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.742590 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.742714 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.742845 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.742971 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.743094 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.743207 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.743416 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.743545 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.743668 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.743801 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.743925 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.744048 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.744180 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.744382 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.744511 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.744634 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.744764 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.744888 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.745020 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.745143 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.745274 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.745397 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.745521 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.745656 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.745822 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.745949 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.746128 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.746253 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.746382 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.746538 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.746690 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.746824 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.747007 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.747144 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.747324 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.747463 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.747646 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.747775 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.747901 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.748026 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.748166 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.748291 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.748423 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.748555 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.748739 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.748874 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.749044 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.749171 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.749347 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.749473 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.749652 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.749787 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.749957 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.750092 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.750259 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.750387 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.750587 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.750732 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.750893 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.751019 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.751197 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.751324 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.751512 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.751646 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.751823 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.751949 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.752142 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.752267 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.752446 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.752573 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.752762 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.752901 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.753175 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.753301 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.753517 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.753709 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.753836 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.753960 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.754083 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.754207 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.754344 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.754562 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.754701 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.754833 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.754959 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.755153 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.755289 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.755477 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.755604 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.755791 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.755919 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.756101 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.756229 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.756413 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.756541 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.756736 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.756874 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.757036 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.757174 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.757298 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.757421 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.757571 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.757699 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.757873 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.758000 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.758179 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.758303 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.758499 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.758628 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.758805 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.758934 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.759109 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.759236 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.759406 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.759546 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.759711 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.759835 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.760011 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.760143 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.760315 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.760450 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.760618 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.760745 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.760921 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.761055 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.761222 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.761361 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.761525 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.761659 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.761825 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.761950 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.762127 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.762255 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.762432 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.762599 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.762772 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.762908 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.763076 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.763216 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.763379 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.763505 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.763757 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.763902 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.764026 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.764158 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.764290 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.764423 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.764562 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.764745 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.764871 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.765003 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.765175 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.765309 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.765479 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.765613 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.765782 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.765918 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.766089 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.766223 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.766394 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.766568 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.766745 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.766884 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.767056 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.767189 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.767352 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.767485 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.767657 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.767786 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.767965 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.768099 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.768268 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.768393 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.768570 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.768699 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.769419 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.769578 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.769705 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.769893 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.770035 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.770204 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.770338 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.770518 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.770646 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.770836 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.770976 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.771142 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.771269 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.771450 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.771577 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.771754 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.771883 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.772077 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.772220 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.772380 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.772506 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.772683 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.772820 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.772995 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.773120 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.773301 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.773428 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.773624 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:10:55.773752 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.773969 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.774105 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.774266 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.774399 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.774620 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.774766 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.774954 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.775089 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.775253 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.775389 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.775564 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.775701 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.775878 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.776013 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.776204 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.776338 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.776518 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.776652 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.776828 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.776963 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.777138 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.777277 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.777449 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.777574 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.777763 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.777895 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.778084 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.778234 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.778398 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.778569 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.778737 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.778866 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.779055 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.779196 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.779363 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.779498 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.779681 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.779807 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.779997 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.780138 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.780312 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.780447 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.780648 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.780775 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.780946 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.781074 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.781257 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.781382 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.781584 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.781716 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.781905 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.782033 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.782221 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.782349 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.782552 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.782681 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.782862 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.782997 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.783170 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.783306 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.783482 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.783616 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.783795 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.783936 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.784124 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.784249 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.784449 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.785147 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.785338 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.785569 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.785704 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.785888 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.786019 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.786483 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.786616 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.786783 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.786912 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.787098 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.787223 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.787417 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.787545 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.787728 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.787863 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.788041 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.788168 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.788358 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.788493 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.788655 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.788782 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.788965 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.789105 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.789274 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.789401 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.789577 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.789705 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.789880 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.790017 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.790183 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.790317 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.790514 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.790646 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.790819 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.790959 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.791131 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.791257 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.791445 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.791572 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.791749 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.791887 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.792068 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.792194 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.792370 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.792496 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.792679 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.792819 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.792987 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.793114 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.793293 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.793421 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.793598 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.793728 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.793907 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.794042 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.794242 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.794369 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.794540 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.794668 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.794837 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.794959 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.795145 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.795272 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.795481 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.795609 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.795755 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.795897 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.796060 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.796204 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.796361 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.796489 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.796676 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.796804 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.796983 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.797116 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.797289 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.797422 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.797599 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.797733 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.797907 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.798044 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.798219 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.798344 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.798550 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.798678 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.798862 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.799002 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.799190 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.799317 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.799505 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.799640 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.799806 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.799940 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.800150 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.800278 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.800472 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.800599 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.800786 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.800915 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.801088 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.801224 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.801395 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.801523 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.801694 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.801823 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.801994 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.802123 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.802295 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.802423 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.802624 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.802760 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.802928 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.803056 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.803228 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.803364 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.803528 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.803655 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.803828 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.803963 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.804129 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.804348 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.804538 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.804666 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.804790 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.804920 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.805057 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.805195 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.805321 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.805459 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.805643 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.805771 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.805929 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.806067 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.806233 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.806362 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.806601 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.806730 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.806935 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.807065 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.807250 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.807378 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.807571 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.807698 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.807883 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.808011 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.808197 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.808333 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.808506 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.808633 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.808819 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.808946 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.809129 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.809263 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.809440 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.809568 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.809755 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.809881 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.810062 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.810188 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.810376 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.810538 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.810709 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.810842 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.811034 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.811172 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.811345 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.811480 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.811657 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.811783 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.811959 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.812092 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.812274 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.812410 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.812599 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.812727 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.812909 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.813043 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.813230 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.813371 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.813548 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.813675 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.813858 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.813985 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.814171 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.814310 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.814486 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.814685 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.814813 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.814937 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.815094 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.815223 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.815405 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.815531 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.815748 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.815964 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.816143 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.816287 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.816381 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.816465 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.816662 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.816772 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.816984 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.817082 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.817291 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.817394 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.817606 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.817702 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.817907 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.818005 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.818220 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.818317 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.818565 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.818698 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.818874 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.818979 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.819189 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.819277 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.819500 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.819596 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.819817 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.819905 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.820126 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.820213 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.820433 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.820530 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.820740 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.820836 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.821044 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.821133 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.821364 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.821464 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.821714 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.821805 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.822027 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.822113 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.822334 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.822421 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.822663 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.822751 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.822970 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.823070 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.823277 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.823373 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.823581 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.823668 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.823886 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.823973 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.824187 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.824282 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.824497 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.824585 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.824804 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.824891 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.825114 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.825203 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.825430 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.825524 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.825746 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.825833 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.826051 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.826139 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.826360 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.826476 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.826713 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.826817 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.827012 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.827098 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.827311 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.827398 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.827611 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.827713 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.827913 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.828001 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.828227 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.828321 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.828534 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.828630 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.828836 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.828929 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.829149 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.829238 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.829480 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.829580 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.829782 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.829880 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.830079 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.830165 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.830387 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.830505 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.830719 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.830807 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.831039 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.831126 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.831866 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.832002 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.832178 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.832341 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.832495 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.832646 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.832785 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.832941 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.833093 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.833256 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.833400 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.833573 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.833746 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.833890 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.834018 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.834205 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.834327 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.834544 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.834660 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.834873 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.834961 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.835186 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.835272 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.835500 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.835596 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.835813 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.836107 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.836194 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.836418 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.836514 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.836738 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.836825 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.837060 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.837298 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.837389 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.837635 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.837723 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.837959 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.838068 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.840712 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.840844 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.840923 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.840999 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.841076 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.841153 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.841153 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.841288 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.841362 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.841437 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.841505 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.841570 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.841643 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.841718 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.841785 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.841850 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.841923 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.841997 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.842065 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.842131 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.842196 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.842269 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.842337 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.842402 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.842507 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.843047 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.843155 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.843227 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.843293 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.843358 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.843423 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.843489 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.843576 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.843649 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.843723 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.843791 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.843866 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.843935 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.844013 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.844081 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.844313 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.844422 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.844616 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.844725 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.844915 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.845053 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.845217 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.845306 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.845556 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.845659 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.845859 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.845947 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.846163 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.846250 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.846492 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.846598 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.846840 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.846976 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.847745 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.847924 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.848084 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.848196 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.848425 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.848574 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.848765 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.848885 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.849080 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.849242 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.849392 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.849542 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.849687 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.849832 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.849978 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.850116 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.850284 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.850428 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.850627 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.850788 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.850936 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.851074 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.851218 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.851356 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.851503 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.851647 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.851793 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.851938 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.852109 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.852252 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.852421 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.852573 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.852733 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.853008 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.853164 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.853334 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.853484 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.853646 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.853783 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.853920 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.854055 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.854225 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.854369 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.854564 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.854703 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.854839 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.854976 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.855205 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.855347 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.855492 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.855648 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.855785 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.855921 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.856057 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.856225 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.856439 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.856580 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.856717 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.856852 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.856995 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.857139 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.857283 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.857429 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.857574 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.857712 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.857848 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.858064 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.858210 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.858348 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.858511 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.858654 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.858793 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.858937 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.859084 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.859221 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.859372 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.859507 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.859656 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.859802 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.859947 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.860084 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.860219 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.860353 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.860502 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.860639 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.860776 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.860913 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.861073 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.861225 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.861370 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.861509 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.861653 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.861797 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.861934 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.862070 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.862240 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.862391 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.862616 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.862758 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.862894 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.863040 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.863195 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.863331 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.863497 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.863641 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.863806 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.863957 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.864103 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.864240 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.864390 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.864527 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.864692 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.864844 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.865016 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.865187 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.865396 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.865537 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.865680 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.865825 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.865964 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.866101 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.866244 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.866413 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.866586 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.866725 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.866861 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.867007 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.867204 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.867348 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.867515 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.867658 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.867831 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.867974 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.868154 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.868297 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.868447 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.868584 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.868752 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.868894 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.869046 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.869190 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.869358 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.869502 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.869661 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.869804 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.869946 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.870083 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.870266 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.870423 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.870594 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.870728 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.870886 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.871053 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.871192 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.871328 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.871508 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.871651 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.871820 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.871968 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.872106 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.872240 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.872411 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.872555 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.872720 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.872872 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.873018 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.873155 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.873322 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.873467 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.873630 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.873781 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.873939 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.874081 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.874248 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.874402 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.874581 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.874720 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.874894 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.875045 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.875203 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.875346 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.875578 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.875721 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.875857 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.875992 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.876128 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.876263 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.876412 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.876548 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.876696 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.876843 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.876981 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.877124 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.877269 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.877414 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.877550 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.877686 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.877850 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.878006 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.878172 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.878324 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.878548 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.878702 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.878866 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.879063 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.879215 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.879357 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.879501 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.879673 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.879866 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.880024 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.880169 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.880311 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.880465 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.880610 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.880755 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.880920 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.881064 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.881218 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.881370 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.881513 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.881663 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.881841 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.881999 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.882143 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.882286 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.882463 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.882714 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.882876 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.883020 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.883162 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.883334 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.883484 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.883635 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.883778 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.883944 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.884097 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.884248 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.884391 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.884542 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.884693 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.884854 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.885000 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.885142 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.885293 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.885438 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.885597 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.885752 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.885896 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.886047 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.886266 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.886413 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.886589 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.886741 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.886898 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.887090 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.887251 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.887397 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.887540 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.887683 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.887826 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.888034 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.888192 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.888337 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.888479 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.888661 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.888821 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.888972 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.889116 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.889259 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.889402 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.889572 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.889725 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.889869 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.890019 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.890174 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.890320 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.890532 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.890692 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.890848 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.890991 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.891145 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.891291 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.891434 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.891578 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.891720 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.891862 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.892014 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.892157 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.892301 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.892443 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.892670 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.892830 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.892982 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.893130 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.893275 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.893418 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.893592 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.893751 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.894428 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.894607 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.894855 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.895003 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.895180 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.895345 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.895502 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.895646 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.895795 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.895938 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.896086 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.896238 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.896391 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.896534 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.896676 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.896818 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.896960 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.897180 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.897337 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.897485 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.897633 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.897776 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.897926 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.898071 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.898213 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.898357 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.898539 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.898687 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.898842 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.898985 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.899128 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.899280 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.899430 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.899574 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.899726 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.899869 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.900021 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.900171 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.900315 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.900457 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.900631 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.900788 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.900933 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.901082 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.901237 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.901388 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.901538 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.901688 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.901839 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.901983 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.902124 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.902275 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.902431 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.902617 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.902761 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.902904 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.903076 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.903250 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.903396 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.903538 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.903681 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.903824 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.904012 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.904174 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.904319 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.904468 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.904637 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.904787 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.904944 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.905099 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.905264 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.905414 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.905556 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.905699 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.905852 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.905998 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.906148 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.906298 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.906497 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.906650 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.906812 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.906958 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.907118 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.907269 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.907413 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.907576 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.907726 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.907870 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.908014 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.908157 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.908299 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.908449 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.908593 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.908742 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.908886 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.909039 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.909183 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.909333 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.910083 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.910234 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.910377 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.910555 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.910701 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.910857 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.911010 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.911404 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.911550 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.911692 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.911857 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.912009 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.912152 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.912295 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.912478 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.912634 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.912787 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.912930 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.913074 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.913215 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.913358 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.913500 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.913702 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.913854 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.913999 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.914140 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.914283 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.914426 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.914681 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.914830 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.914973 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.915115 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.915257 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.915401 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.915554 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.915715 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.915859 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.916001 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.916143 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.916294 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.916439 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.916588 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.916733 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.916875 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.917017 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.917168 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.917319 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.917468 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.917626 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.917769 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.917913 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.918064 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.918379 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.918562 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.918708 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.918852 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.918993 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.919147 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.919299 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.919443 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.919604 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.919747 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.919903 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.920048 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.920190 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.920332 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.920475 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.920618 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.920768 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.920947 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.921103 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.921254 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.921397 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.921558 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.921713 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.921858 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.922006 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.922149 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.922291 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.922478 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.922630 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.922775 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.923003 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.923154 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.923362 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.923539 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.923684 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.923827 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.923971 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.924115 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.924271 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.924416 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.924562 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.924712 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.924856 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.924998 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.925187 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.925443 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.925620 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.925777 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.925944 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.926173 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.926328 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.926499 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.926652 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.926832 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.926996 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.927150 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.927306 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.927449 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.927592 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.927742 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.927897 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.928050 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.928195 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.928338 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.928481 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.928624 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.928780 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.928925 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.929075 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.929229 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.929373 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.929716 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.929896 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.930046 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.930190 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.930340 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.930510 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.930661 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.930817 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.930961 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.931104 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.931258 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.931410 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.931555 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.931759 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.931910 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.932091 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.932241 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.932399 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.932550 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.932695 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.932838 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.932980 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.933124 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.933278 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.933430 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.933574 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.933723 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.933868 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.934011 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.934153 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.934305 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.934498 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.934660 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.934805 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.934947 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.935195 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.935370 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.935522 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.935665 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.935809 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.935950 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.936105 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.936256 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.936443 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.936591 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.936859 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.937007 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.937194 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.937354 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.937498 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.937641 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.937784 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.937927 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.938089 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.938234 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.938378 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.938554 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.938699 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.938853 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.938997 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.939147 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.939309 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.939454 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.939597 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.939748 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.939892 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.940035 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.940177 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.940347 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.940496 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.941182 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.941396 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.941553 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.941697 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.941944 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.942094 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.942250 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.942394 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.942601 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.942748 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.942900 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.943056 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.943207 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.943351 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.943494 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.943636 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.943779 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.943940 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.944085 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.944236 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.944379 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.944522 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.944663 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.944815 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.944958 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.945108 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.945251 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.945394 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.945536 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.945701 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.945845 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.945998 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.946148 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.946293 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.946466 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.946633 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.946778 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.946922 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.947071 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.947215 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.947365 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.947510 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.947670 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.947813 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.947965 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.948161 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.948312 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.948457 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.948609 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.948754 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.948904 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.949049 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.949247 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.949393 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.949536 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.949697 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.949840 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.949991 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.950182 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.950339 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.950533 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.950683 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.950827 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.950990 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.951136 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.951321 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.951476 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.951626 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.951824 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.951983 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.952142 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.952293 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.952437 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.952581 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.952723 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.952874 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.953018 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.953169 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.953313 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.953456 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.953616 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.953774 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.953918 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.954069 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.954214 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.954357 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.954543 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.954693 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.954843 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.954989 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.955139 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.955283 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.955500 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.955657 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.955801 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.955943 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.956094 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.956247 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.956936 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.957089 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.957257 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.957416 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.957599 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.957760 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.957904 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.958058 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.958201 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.958345 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.958543 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.958716 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.958861 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.959004 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.959192 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.959342 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.959515 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.959673 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.959817 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.959961 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.960139 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.960289 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.960440 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.960585 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.960758 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.960908 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.961051 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.961192 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.961368 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.961518 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.961689 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.961839 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.962001 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.962145 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.962333 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.962529 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.962681 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.962832 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.962975 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.963127 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.963271 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.963413 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.963585 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.963737 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.963898 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.964054 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.964199 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.964343 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.964512 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.964663 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.964844 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.965003 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.965170 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.965320 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.965492 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.965644 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.965800 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.965965 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.966109 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.966252 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.966402 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.966576 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.966736 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.966882 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.967024 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.967167 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.967310 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.967452 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.967603 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.967764 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.967909 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.968052 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.968194 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.968344 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.968488 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.968631 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.968784 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.968937 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.969086 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.969239 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.969390 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.969533 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.969685 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.969829 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.969972 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.970123 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.970266 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.970409 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.970601 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.970745 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.970925 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.971085 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.971236 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.971380 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.971522 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.971682 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.971838 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.972021 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.972166 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.972309 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.972474 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.972671 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.972827 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.972973 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.973116 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.973272 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.973416 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.973559 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.973721 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.973872 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.974016 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.974161 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.974309 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.974476 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.974638 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.974784 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.974927 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.975069 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.975212 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.975363 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.975516 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.975659 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.975808 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.975959 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.976103 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.976265 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.976409 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.976553 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.976694 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.976843 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.976986 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.977140 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.977291 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.977449 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.977592 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.977736 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.977878 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.978029 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.978172 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.978317 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.978482 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.978633 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.978842 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.979005 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.979156 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.979310 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.979454 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.979604 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.979760 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.979905 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.980047 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.980190 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.980331 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.980475 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.980629 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.980773 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.980923 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.981067 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.981226 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.981382 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.981526 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.981676 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.981819 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.981969 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.982112 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.982263 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.982415 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.982641 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.982796 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.982939 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.983099 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.983256 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.983400 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.983544 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.983693 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.983844 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.984062 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.984209 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.984351 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.984494 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.984638 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.984781 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.984935 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.985090 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.985234 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.985377 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.985520 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.985670 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.985821 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.985966 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.986108 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.986251 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.986393 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.986562 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.986719 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.986876 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.987018 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.987160 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.987303 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 21:10:55.987455 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.987827 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.988166 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.988477 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.988794 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.989103 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:10:55.989351 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103313) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 21:10:56.011214 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG oslo_db.sqlalchemy.engines [None req-0eafa5e2-d543-4ccd-8146-01c7818a1ab0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 21:10:56.012788 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG oslo_db.sqlalchemy.engines [None req-a20d3cf6-7bf9-4136-b771-75f9f6fe014d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103313) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 21:10:56.076254 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.context [None req-0eafa5e2-d543-4ccd-8146-01c7818a1ab0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),618a26cc-a7ee-4518-9a96-cde8a6bd82c4(cell1) {{(pid=103314) load_cells /opt/stack/nova/nova/context.py:464}} May 10 21:10:56.077316 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.context [None req-a20d3cf6-7bf9-4136-b771-75f9f6fe014d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),618a26cc-a7ee-4518-9a96-cde8a6bd82c4(cell1) {{(pid=103313) load_cells /opt/stack/nova/nova/context.py:464}} May 10 21:10:56.080607 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-0eafa5e2-d543-4ccd-8146-01c7818a1ab0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:56.081773 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG oslo_concurrency.lockutils [None req-a20d3cf6-7bf9-4136-b771-75f9f6fe014d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:56.082199 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-0eafa5e2-d543-4ccd-8146-01c7818a1ab0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:56.083003 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-0eafa5e2-d543-4ccd-8146-01c7818a1ab0 None None] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:56.083452 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG oslo_concurrency.lockutils [None req-a20d3cf6-7bf9-4136-b771-75f9f6fe014d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:56.084247 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG oslo_concurrency.lockutils [None req-a20d3cf6-7bf9-4136-b771-75f9f6fe014d None None] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:56.084904 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-0eafa5e2-d543-4ccd-8146-01c7818a1ab0 None None] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:56.086140 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG oslo_concurrency.lockutils [None req-a20d3cf6-7bf9-4136-b771-75f9f6fe014d None None] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103313) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:56.095784 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG oslo_db.sqlalchemy.engines [None req-0eafa5e2-d543-4ccd-8146-01c7818a1ab0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 21:10:56.099839 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG oslo_db.sqlalchemy.engines [None req-0eafa5e2-d543-4ccd-8146-01c7818a1ab0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 21:10:56.103414 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG oslo_db.sqlalchemy.engines [None req-a20d3cf6-7bf9-4136-b771-75f9f6fe014d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103313) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 21:10:56.106504 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG oslo_db.sqlalchemy.engines [None req-a20d3cf6-7bf9-4136-b771-75f9f6fe014d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103313) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 21:10:56.260400 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG oslo_db.sqlalchemy.engines [None req-0eafa5e2-d543-4ccd-8146-01c7818a1ab0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 21:10:56.270605 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG oslo_db.sqlalchemy.engines [None req-a20d3cf6-7bf9-4136-b771-75f9f6fe014d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103313) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 21:10:56.688761 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: WARNING keystonemiddleware.auth_token [None req-0eafa5e2-d543-4ccd-8146-01c7818a1ab0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 21:10:56.696366 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: WARNING keystonemiddleware.auth_token [None req-0eafa5e2-d543-4ccd-8146-01c7818a1ab0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 21:10:56.716034 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: WARNING keystonemiddleware.auth_token [None req-a20d3cf6-7bf9-4136-b771-75f9f6fe014d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 21:10:56.724239 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: WARNING keystonemiddleware.auth_token [None req-a20d3cf6-7bf9-4136-b771-75f9f6fe014d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 21:10:57.041931 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: WARNING keystonemiddleware.auth_token [None req-0eafa5e2-d543-4ccd-8146-01c7818a1ab0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 21:10:57.047947 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: WARNING keystonemiddleware.auth_token [None req-0eafa5e2-d543-4ccd-8146-01c7818a1ab0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 21:10:57.054094 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5602515819c0 pid: 103314 (default app) May 10 21:10:57.056168 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-0eafa5e2-d543-4ccd-8146-01c7818a1ab0 None None] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:57.057353 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-0eafa5e2-d543-4ccd-8146-01c7818a1ab0 None None] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001729 May 10 21:10:57.057771 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 788 bytes} [Tue May 10 21:10:57 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:10:57.074286 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: WARNING keystonemiddleware.auth_token [None req-a20d3cf6-7bf9-4136-b771-75f9f6fe014d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 21:10:57.080384 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: WARNING keystonemiddleware.auth_token [None req-a20d3cf6-7bf9-4136-b771-75f9f6fe014d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 21:10:57.087402 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5602515819c0 pid: 103313 (default app) May 10 21:12:17.478536 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-0eafa5e2-d543-4ccd-8146-01c7818a1ab0 None None] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:17.479559 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-0eafa5e2-d543-4ccd-8146-01c7818a1ab0 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 May 10 21:12:17.479961 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 2/2] 10.222.0.25 () {54 vars in 930 bytes} [Tue May 10 21:12:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:12:17.907702 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-d73a44bd-341b-4020-823c-d443d4f61f13 admin admin] Calling method '>' {{(pid=103313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:17.937720 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: INFO nova.api.openstack.requestlog [None req-d73a44bd-341b-4020-823c-d443d4f61f13 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.450728 May 10 21:12:17.938520 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: [pid: 103313|app: 0|req: 1/3] 10.222.0.25 () {60 vars in 1291 bytes} [Tue May 10 21:12:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:20.253333 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-0eafa5e2-d543-4ccd-8146-01c7818a1ab0 None None] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:20.254373 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-0eafa5e2-d543-4ccd-8146-01c7818a1ab0 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 May 10 21:12:20.254878 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 3/4] 10.222.0.25 () {54 vars in 930 bytes} [Tue May 10 21:12:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:12:20.315099 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-080df976-9b3e-4064-bff8-bbe6eaaebcb8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "rxtx_factor": 1.0, "name": "cirros256", "ram": 256, "id": "c1"}} {{(pid=103313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:12:20.335551 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 21:12:20.335551 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: warnings.warn(msg) May 10 21:12:20.418177 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: INFO nova.api.openstack.requestlog [None req-080df976-9b3e-4064-bff8-bbe6eaaebcb8 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.156904 May 10 21:12:20.418952 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: [pid: 103313|app: 0|req: 2/5] 10.222.0.25 () {64 vars in 1282 bytes} [Tue May 10 21:12:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:12:20.634229 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-39ff1042-cd0e-43f0-a774-5942146e5e3d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:12:20.636693 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 21:12:20.636693 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: warnings.warn(msg) May 10 21:12:20.760398 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-39ff1042-cd0e-43f0-a774-5942146e5e3d admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.333051 May 10 21:12:20.764822 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 4/6] 10.222.0.25 () {64 vars in 1335 bytes} [Tue May 10 21:12:20 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:23.062298 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-080df976-9b3e-4064-bff8-bbe6eaaebcb8 admin admin] Calling method '>' {{(pid=103313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:23.063272 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: INFO nova.api.openstack.requestlog [None req-080df976-9b3e-4064-bff8-bbe6eaaebcb8 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 May 10 21:12:23.064009 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: [pid: 103313|app: 0|req: 3/7] 10.222.0.25 () {54 vars in 930 bytes} [Tue May 10 21:12:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:12:23.167845 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-3f57ee67-089c-42d6-aff0-dd6fd34b9b65 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "swap": 0, "rxtx_factor": 1.0, "ram": 512, "os-flavor-access:is_public": true, "name": "ds512M"}} {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:12:23.186130 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 21:12:23.186130 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: warnings.warn(msg) May 10 21:12:23.297353 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-3f57ee67-089c-42d6-aff0-dd6fd34b9b65 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.225358 May 10 21:12:23.297353 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 5/8] 10.222.0.25 () {64 vars in 1282 bytes} [Tue May 10 21:12:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:12:23.309956 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-a1eccb31-2c18-491f-8d65-311380a3ec5e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:12:23.312278 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 21:12:23.312278 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: warnings.warn(msg) May 10 21:12:23.440300 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: INFO nova.api.openstack.requestlog [None req-a1eccb31-2c18-491f-8d65-311380a3ec5e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.135183 May 10 21:12:23.441253 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: [pid: 103313|app: 0|req: 4/9] 10.222.0.25 () {64 vars in 1335 bytes} [Tue May 10 21:12:23 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:12:25.719984 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-3f57ee67-089c-42d6-aff0-dd6fd34b9b65 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:25.721007 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-3f57ee67-089c-42d6-aff0-dd6fd34b9b65 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 May 10 21:12:25.721424 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 6/10] 10.222.0.25 () {54 vars in 930 bytes} [Tue May 10 21:12:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:12:25.780782 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-b0817450-335a-49e7-b558-43aa56761e99 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 10, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "ram": 1024, "swap": 0, "id": "d2", "rxtx_factor": 1.0}} {{(pid=103313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:12:25.861894 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: INFO nova.api.openstack.requestlog [None req-b0817450-335a-49e7-b558-43aa56761e99 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.133878 May 10 21:12:25.862656 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: [pid: 103313|app: 0|req: 5/11] 10.222.0.25 () {64 vars in 1282 bytes} [Tue May 10 21:12:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:12:25.875552 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-f73fa2f5-2236-4140-8dbf-cac99c467225 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:12:25.948760 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-f73fa2f5-2236-4140-8dbf-cac99c467225 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.077312 May 10 21:12:25.949510 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 7/12] 10.222.0.25 () {64 vars in 1335 bytes} [Tue May 10 21:12:25 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:28.239533 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-b0817450-335a-49e7-b558-43aa56761e99 admin admin] Calling method '>' {{(pid=103313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:28.241169 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: INFO nova.api.openstack.requestlog [None req-b0817450-335a-49e7-b558-43aa56761e99 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002049 May 10 21:12:28.241773 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: [pid: 103313|app: 0|req: 6/13] 10.222.0.25 () {54 vars in 930 bytes} [Tue May 10 21:12:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:12:28.300298 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-5906cfe8-e1fb-48a0-b8f9-a90c873ec90e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "rxtx_factor": 1.0, "name": "ds2G", "vcpus": 2, "swap": 0, "disk": 10, "os-flavor-access:is_public": true, "id": "d3"}} {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:12:28.384580 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-5906cfe8-e1fb-48a0-b8f9-a90c873ec90e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.136568 May 10 21:12:28.385325 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 8/14] 10.222.0.25 () {64 vars in 1282 bytes} [Tue May 10 21:12:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:12:28.397195 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-972af56d-fe4c-4b33-a199-b96d4cc7bb6d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:12:28.457858 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: INFO nova.api.openstack.requestlog [None req-972af56d-fe4c-4b33-a199-b96d4cc7bb6d admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.063733 May 10 21:12:28.458676 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: [pid: 103313|app: 0|req: 7/15] 10.222.0.25 () {64 vars in 1335 bytes} [Tue May 10 21:12:28 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:30.768705 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-5906cfe8-e1fb-48a0-b8f9-a90c873ec90e admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:30.769764 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-5906cfe8-e1fb-48a0-b8f9-a90c873ec90e admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 May 10 21:12:30.770162 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 9/16] 10.222.0.25 () {54 vars in 930 bytes} [Tue May 10 21:12:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:12:30.835133 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-be097d0b-5873-4fdf-a3ee-840d05b9aeb6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 4096, "name": "ds4G", "disk": 20, "vcpus": 4, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d4"}} {{(pid=103313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:12:30.915899 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: INFO nova.api.openstack.requestlog [None req-be097d0b-5873-4fdf-a3ee-840d05b9aeb6 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.139977 May 10 21:12:30.916458 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: [pid: 103313|app: 0|req: 8/17] 10.222.0.25 () {64 vars in 1282 bytes} [Tue May 10 21:12:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:12:30.928879 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-137bf1f8-ad2e-497f-8b69-df319ee2004d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:12:30.999459 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-137bf1f8-ad2e-497f-8b69-df319ee2004d admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074837 May 10 21:12:31.010574 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 10/18] 10.222.0.25 () {64 vars in 1335 bytes} [Tue May 10 21:12:30 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:33.317103 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-be097d0b-5873-4fdf-a3ee-840d05b9aeb6 admin admin] Calling method '>' {{(pid=103313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:33.318809 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: INFO nova.api.openstack.requestlog [None req-be097d0b-5873-4fdf-a3ee-840d05b9aeb6 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002815 May 10 21:12:33.319380 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: [pid: 103313|app: 0|req: 9/19] 10.222.0.25 () {54 vars in 930 bytes} [Tue May 10 21:12:33 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:12:33.383076 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-850aff6e-4f97-484c-b0db-e94324120ea5 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:33.406845 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-850aff6e-4f97-484c-b0db-e94324120ea5 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081250 May 10 21:12:33.407503 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 11/20] 10.222.0.25 () {60 vars in 1291 bytes} [Tue May 10 21:12:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:12:35.805915 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-be097d0b-5873-4fdf-a3ee-840d05b9aeb6 admin admin] Calling method '>' {{(pid=103313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:35.806990 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: INFO nova.api.openstack.requestlog [None req-be097d0b-5873-4fdf-a3ee-840d05b9aeb6 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 May 10 21:12:35.807409 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: [pid: 103313|app: 0|req: 10/21] 10.222.0.25 () {54 vars in 930 bytes} [Tue May 10 21:12:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:12:35.877093 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-a2ad0d49-8e7b-49ec-bea1-c23c165fa3f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "os-flavor-access:is_public": true, "swap": 0, "name": "m1.tiny", "disk": 1, "ram": 512, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:12:35.955095 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-a2ad0d49-8e7b-49ec-bea1-c23c165fa3f4 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.141924 May 10 21:12:35.955845 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 12/22] 10.222.0.25 () {64 vars in 1282 bytes} [Tue May 10 21:12:35 2022] POST /compute/v2.1/flavors => generated 402 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:12:35.970701 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-757b3cf5-d8b4-4472-be27-b29b06b3ed93 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:12:36.079246 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: INFO nova.api.openstack.requestlog [None req-757b3cf5-d8b4-4472-be27-b29b06b3ed93 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.112226 May 10 21:12:36.079924 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: [pid: 103313|app: 0|req: 11/23] 10.222.0.25 () {64 vars in 1332 bytes} [Tue May 10 21:12:35 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:38.437876 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-a2ad0d49-8e7b-49ec-bea1-c23c165fa3f4 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:38.439284 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-a2ad0d49-8e7b-49ec-bea1-c23c165fa3f4 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001891 May 10 21:12:38.439820 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 930 bytes} [Tue May 10 21:12:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:12:38.500401 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-48fcda9c-eca4-42b9-befc-e350d5d6d702 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 20, "ram": 2048, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "id": "2", "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:12:38.581255 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: INFO nova.api.openstack.requestlog [None req-48fcda9c-eca4-42b9-befc-e350d5d6d702 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.132751 May 10 21:12:38.582072 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: [pid: 103313|app: 0|req: 12/25] 10.222.0.25 () {64 vars in 1282 bytes} [Tue May 10 21:12:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:12:38.598153 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-50d94538-e39b-4648-a8fd-5c898110acf6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:12:38.679909 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-50d94538-e39b-4648-a8fd-5c898110acf6 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087398 May 10 21:12:38.680419 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 14/26] 10.222.0.25 () {64 vars in 1332 bytes} [Tue May 10 21:12:38 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:40.959565 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-48fcda9c-eca4-42b9-befc-e350d5d6d702 admin admin] Calling method '>' {{(pid=103313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:40.960640 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: INFO nova.api.openstack.requestlog [None req-48fcda9c-eca4-42b9-befc-e350d5d6d702 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 May 10 21:12:40.961043 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: [pid: 103313|app: 0|req: 13/27] 10.222.0.25 () {54 vars in 930 bytes} [Tue May 10 21:12:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:12:41.018220 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-ad2d249b-42a8-4e99-8607-7aeff5ceeacf admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "disk": 40, "ram": 4096, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "rxtx_factor": 1.0, "name": "m1.medium"}} {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:12:41.086742 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-ad2d249b-42a8-4e99-8607-7aeff5ceeacf admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.119982 May 10 21:12:41.087302 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 15/28] 10.222.0.25 () {64 vars in 1282 bytes} [Tue May 10 21:12:40 2022] POST /compute/v2.1/flavors => generated 406 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:12:41.099552 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-6a0d7b7e-4453-4496-abbe-53db559ffdb7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:12:41.158985 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: INFO nova.api.openstack.requestlog [None req-6a0d7b7e-4453-4496-abbe-53db559ffdb7 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.063522 May 10 21:12:41.160363 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: [pid: 103313|app: 0|req: 14/29] 10.222.0.25 () {64 vars in 1332 bytes} [Tue May 10 21:12:41 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:43.427062 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-ad2d249b-42a8-4e99-8607-7aeff5ceeacf admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:43.428214 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-ad2d249b-42a8-4e99-8607-7aeff5ceeacf admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001616 May 10 21:12:43.428858 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 16/30] 10.222.0.25 () {54 vars in 930 bytes} [Tue May 10 21:12:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:12:43.484383 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-84681bcd-0d8b-497f-8f05-96c55e068718 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "os-flavor-access:is_public": true, "vcpus": 4, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "rxtx_factor": 1.0, "name": "m1.large", "swap": 0}} {{(pid=103313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:12:43.549240 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: INFO nova.api.openstack.requestlog [None req-84681bcd-0d8b-497f-8f05-96c55e068718 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.114591 May 10 21:12:43.549810 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: [pid: 103313|app: 0|req: 15/31] 10.222.0.25 () {64 vars in 1282 bytes} [Tue May 10 21:12:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:12:43.562063 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-dc8f171f-30da-4aa2-a7a0-31c9f22f0a24 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:12:43.627255 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-dc8f171f-30da-4aa2-a7a0-31c9f22f0a24 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.068701 May 10 21:12:43.627769 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 17/32] 10.222.0.25 () {64 vars in 1332 bytes} [Tue May 10 21:12:43 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:45.931146 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-84681bcd-0d8b-497f-8f05-96c55e068718 admin admin] Calling method '>' {{(pid=103313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:45.932168 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: INFO nova.api.openstack.requestlog [None req-84681bcd-0d8b-497f-8f05-96c55e068718 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 May 10 21:12:45.932865 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: [pid: 103313|app: 0|req: 16/33] 10.222.0.25 () {54 vars in 930 bytes} [Tue May 10 21:12:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:12:45.993689 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-72a88199-7f77-4a83-8cde-2f06deb34f6d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 8, "name": "m1.xlarge", "ram": 16384, "swap": 0, "disk": 160, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:12:46.241586 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-72a88199-7f77-4a83-8cde-2f06deb34f6d admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.302967 May 10 21:12:46.242044 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 18/34] 10.222.0.25 () {64 vars in 1282 bytes} [Tue May 10 21:12:45 2022] POST /compute/v2.1/flavors => generated 408 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:12:46.254391 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-432e2f3d-7579-4da0-8fc2-2a6e6956f468 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:12:46.325451 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: INFO nova.api.openstack.requestlog [None req-432e2f3d-7579-4da0-8fc2-2a6e6956f468 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.075233 May 10 21:12:46.326046 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: [pid: 103313|app: 0|req: 17/35] 10.222.0.25 () {64 vars in 1332 bytes} [Tue May 10 21:12:46 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:10.902638 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-72a88199-7f77-4a83-8cde-2f06deb34f6d admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:10.903647 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-72a88199-7f77-4a83-8cde-2f06deb34f6d admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 May 10 21:13:10.904044 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 19/36] 10.222.0.25 () {54 vars in 930 bytes} [Tue May 10 21:13:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:13:10.961304 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-6953d077-71b8-44a0-92df-5f9caba5dd81 admin admin] Calling method '>' {{(pid=103313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:10.978765 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: INFO nova.api.openstack.requestlog [None req-6953d077-71b8-44a0-92df-5f9caba5dd81 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068436 May 10 21:13:10.984775 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: [pid: 103313|app: 0|req: 18/37] 10.222.0.25 () {60 vars in 1291 bytes} [Tue May 10 21:13:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:13:11.977230 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-72a88199-7f77-4a83-8cde-2f06deb34f6d admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:11.978230 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-72a88199-7f77-4a83-8cde-2f06deb34f6d admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 May 10 21:13:11.978654 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 20/38] 10.222.0.25 () {56 vars in 1074 bytes} [Tue May 10 21:13:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:13:12.188622 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-fe939181-1a55-49d3-bcb5-a39a1233c00d admin admin] Calling method '>' {{(pid=103313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:12.195063 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: INFO nova.api.openstack.wsgi [None req-fe939181-1a55-49d3-bcb5-a39a1233c00d admin admin] HTTP exception thrown: Flavor 42 could not be found. May 10 21:13:12.198365 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-fe939181-1a55-49d3-bcb5-a39a1233c00d admin admin] Request method failure captured: May 10 21:13:12.198365 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 10 21:13:12.198365 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: Accept: application/json May 10 21:13:12.198365 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: Accept-Encoding: gzip, deflate May 10 21:13:12.198365 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: Connection: keep-alive May 10 21:13:12.198365 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: Content-Length: 0 May 10 21:13:12.198365 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: Host: 10.222.0.25 May 10 21:13:12.198365 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: Openstack-Api-Version: compute 2.90 May 10 21:13:12.198365 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: Openstack-System-Scope: None May 10 21:13:12.198365 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: User-Agent: python-novaclient May 10 21:13:12.198365 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Auth-Token: gAAAAABietVnyb28ai9S1VLX-JEIg_xmpzorF0CNAaMHrlx7d5LAfqzgJ3K2SYiS01ZcoH5EBFp_lU52Q7yVF01xVlfQ6-RZ4ssy2ejRt424nCMSUhnN6V6rNnSvcXzYGdqJz-rWeJ7BDz8hPmKO1i0yJ4bdQRmTEfn3Z5ac9Pu3MhEz64AWZWU May 10 21:13:12.198365 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Domain-Id: None May 10 21:13:12.198365 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Domain-Name: None May 10 21:13:12.198365 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Identity-Status: Confirmed May 10 21:13:12.198365 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Is-Admin-Project: True May 10 21:13:12.198365 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Openstack-Nova-Api-Version: 2.90 May 10 21:13:12.198365 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Project-Domain-Id: default May 10 21:13:12.198365 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Project-Domain-Name: Default May 10 21:13:12.198365 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Project-Id: 3ea6acf0b7844ccca48ba57f57c13860 May 10 21:13:12.198365 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Project-Name: admin May 10 21:13:12.198365 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Role: admin,member,reader May 10 21:13:12.198365 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Roles: admin,member,reader May 10 21:13:12.200076 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ea6acf0b7844ccca48ba57f57c13860"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3ea6acf0b7844ccca48ba57f57c13860"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ea6acf0b7844ccca48ba57f57c13860"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3ea6acf0b7844ccca48ba57f57c13860"}]}] May 10 21:13:12.200076 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Tenant: admin May 10 21:13:12.200076 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Tenant-Id: 3ea6acf0b7844ccca48ba57f57c13860 May 10 21:13:12.200076 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Tenant-Name: admin May 10 21:13:12.200076 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-User: admin May 10 21:13:12.200076 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-User-Domain-Id: default May 10 21:13:12.200076 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-User-Domain-Name: Default May 10 21:13:12.200076 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-User-Id: 94be445c202a4e67aef3505af25af405 May 10 21:13:12.200076 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-User-Name: admin May 10 21:13:12.200076 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: method: > May 10 21:13:12.200076 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: exception: Flavor 42 could not be found. May 10 21:13:12.200076 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: action_args: {'id': '42'} May 10 21:13:12.200076 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: {{(pid=103313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:13:12.200076 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:13:12.201127 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 21:13:12.201127 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 21:13:12.201127 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 21:13:12.201127 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 21:13:12.201127 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 21:13:12.201127 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 21:13:12.201127 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 21:13:12.201127 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 21:13:12.201127 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 21:13:12.201127 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:13:12.201127 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 21:13:12.201127 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 21:13:12.201127 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 10 21:13:12.201127 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi May 10 21:13:12.201127 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:13:12.201127 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi May 10 21:13:12.201127 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:13:12.201127 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:13:12.201127 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:13:12.202634 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:13:12.202634 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:13:12.202634 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:13:12.202634 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:13:12.202634 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 21:13:12.202634 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 21:13:12.202634 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 10 21:13:12.202634 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi May 10 21:13:12.202634 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:13:12.202634 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi May 10 21:13:12.202634 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:13:12.202634 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:13:12.202634 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:13:12.202634 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:13:12.202634 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:13:12.202634 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 10 21:13:12.202634 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi May 10 21:13:12.202634 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-fe939181-1a55-49d3-bcb5-a39a1233c00d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:13:12.203956 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: INFO nova.api.openstack.requestlog [None req-fe939181-1a55-49d3-bcb5-a39a1233c00d admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061772 May 10 21:13:12.203956 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: [pid: 103313|app: 0|req: 19/39] 10.222.0.25 () {60 vars in 1190 bytes} [Tue May 10 21:13:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 21:13:12.210948 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-a1d3848a-d5dd-4999-9eb3-3e971c5f32c7 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:12.233258 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-a1d3848a-d5dd-4999-9eb3-3e971c5f32c7 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027108 May 10 21:13:12.233811 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 21/40] 10.222.0.25 () {60 vars in 1210 bytes} [Tue May 10 21:13:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:13:12.244020 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-623d996a-d84b-4566-b48f-e8ee8d90b9ca admin admin] Calling method '>' {{(pid=103313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:12.265062 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: INFO nova.api.openstack.requestlog [None req-623d996a-d84b-4566-b48f-e8ee8d90b9ca admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024595 May 10 21:13:12.265598 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: [pid: 103313|app: 0|req: 20/41] 10.222.0.25 () {60 vars in 1210 bytes} [Tue May 10 21:13:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:13:12.275257 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-0bc02e0c-b873-4984-988d-8056f154c9b1 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:12.280625 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.wsgi [None req-0bc02e0c-b873-4984-988d-8056f154c9b1 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 10 21:13:12.284137 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-0bc02e0c-b873-4984-988d-8056f154c9b1 admin admin] Request method failure captured: May 10 21:13:12.284137 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 10 21:13:12.284137 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: Accept: application/json May 10 21:13:12.284137 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: Accept-Encoding: gzip, deflate May 10 21:13:12.284137 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: Connection: keep-alive May 10 21:13:12.284137 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: Content-Length: 0 May 10 21:13:12.284137 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: Host: 10.222.0.25 May 10 21:13:12.284137 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: Openstack-Api-Version: compute 2.90 May 10 21:13:12.284137 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: Openstack-System-Scope: None May 10 21:13:12.284137 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: User-Agent: python-novaclient May 10 21:13:12.284137 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Auth-Token: gAAAAABietVnyb28ai9S1VLX-JEIg_xmpzorF0CNAaMHrlx7d5LAfqzgJ3K2SYiS01ZcoH5EBFp_lU52Q7yVF01xVlfQ6-RZ4ssy2ejRt424nCMSUhnN6V6rNnSvcXzYGdqJz-rWeJ7BDz8hPmKO1i0yJ4bdQRmTEfn3Z5ac9Pu3MhEz64AWZWU May 10 21:13:12.284137 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Domain-Id: None May 10 21:13:12.284137 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Domain-Name: None May 10 21:13:12.284137 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Identity-Status: Confirmed May 10 21:13:12.284137 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Is-Admin-Project: True May 10 21:13:12.284137 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Openstack-Nova-Api-Version: 2.90 May 10 21:13:12.284137 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Project-Domain-Id: default May 10 21:13:12.284137 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Project-Domain-Name: Default May 10 21:13:12.284137 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Project-Id: 3ea6acf0b7844ccca48ba57f57c13860 May 10 21:13:12.284137 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Project-Name: admin May 10 21:13:12.284137 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Role: admin,member,reader May 10 21:13:12.284137 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Roles: admin,member,reader May 10 21:13:12.286259 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ea6acf0b7844ccca48ba57f57c13860"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3ea6acf0b7844ccca48ba57f57c13860"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ea6acf0b7844ccca48ba57f57c13860"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3ea6acf0b7844ccca48ba57f57c13860"}]}] May 10 21:13:12.286259 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Tenant: admin May 10 21:13:12.286259 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Tenant-Id: 3ea6acf0b7844ccca48ba57f57c13860 May 10 21:13:12.286259 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Tenant-Name: admin May 10 21:13:12.286259 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-User: admin May 10 21:13:12.286259 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-User-Domain-Id: default May 10 21:13:12.286259 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-User-Domain-Name: Default May 10 21:13:12.286259 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-User-Id: 94be445c202a4e67aef3505af25af405 May 10 21:13:12.286259 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-User-Name: admin May 10 21:13:12.286259 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: method: > May 10 21:13:12.286259 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: exception: Flavor 42 could not be found. May 10 21:13:12.286259 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: action_args: {'id': '42'} May 10 21:13:12.286259 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:13:12.286259 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:13:12.287138 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 21:13:12.287138 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 21:13:12.287138 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 21:13:12.287138 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 21:13:12.287138 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 21:13:12.287138 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 21:13:12.287138 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 21:13:12.287138 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 21:13:12.287138 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 21:13:12.287138 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:13:12.287138 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 21:13:12.287138 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 21:13:12.287138 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 10 21:13:12.287138 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi May 10 21:13:12.287138 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:13:12.287138 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi May 10 21:13:12.287138 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:13:12.287138 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:13:12.287138 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:13:12.288485 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:13:12.288485 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:13:12.288485 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:13:12.288485 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:13:12.288485 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 21:13:12.288485 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 21:13:12.288485 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 10 21:13:12.288485 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi May 10 21:13:12.288485 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:13:12.288485 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi May 10 21:13:12.288485 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:13:12.288485 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:13:12.288485 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:13:12.288485 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:13:12.288485 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:13:12.288485 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 10 21:13:12.288485 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi May 10 21:13:12.288485 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-0bc02e0c-b873-4984-988d-8056f154c9b1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:13:12.289695 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-0bc02e0c-b873-4984-988d-8056f154c9b1 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014483 May 10 21:13:12.289695 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 22/42] 10.222.0.25 () {60 vars in 1190 bytes} [Tue May 10 21:13:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 21:13:13.181065 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-623d996a-d84b-4566-b48f-e8ee8d90b9ca admin admin] Calling method '>' {{(pid=103313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:13.182106 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: INFO nova.api.openstack.requestlog [None req-623d996a-d84b-4566-b48f-e8ee8d90b9ca admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 May 10 21:13:13.182530 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: [pid: 103313|app: 0|req: 21/43] 10.222.0.25 () {56 vars in 1074 bytes} [Tue May 10 21:13:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:13:13.370949 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-e255f406-5bfa-4e94-8a5e-4b7335fee8bd admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:13.376195 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.wsgi [None req-e255f406-5bfa-4e94-8a5e-4b7335fee8bd admin admin] HTTP exception thrown: Flavor 84 could not be found. May 10 21:13:13.377684 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-e255f406-5bfa-4e94-8a5e-4b7335fee8bd admin admin] Request method failure captured: May 10 21:13:13.377684 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 10 21:13:13.377684 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: Accept: application/json May 10 21:13:13.377684 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: Accept-Encoding: gzip, deflate May 10 21:13:13.377684 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: Connection: keep-alive May 10 21:13:13.377684 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: Content-Length: 0 May 10 21:13:13.377684 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: Host: 10.222.0.25 May 10 21:13:13.377684 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: Openstack-Api-Version: compute 2.90 May 10 21:13:13.377684 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: Openstack-System-Scope: None May 10 21:13:13.377684 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: User-Agent: python-novaclient May 10 21:13:13.377684 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Auth-Token: gAAAAABietVp7oCHs-fRBpVkJQsN-dgw-IDqWHZjUzlERiaav0xmBDYTV7FFe4QwvgudRLPvHbW2hEbEIgaDRy1IMTFAgU5t_qQDKf5C4cfsPxWEeFao9Y7Cn5SczzWVCfEm0--SUpmFE-aHTv5QS2wZ7JgPcMCe-vsKYkko8tDS7KdZeYIuzD8 May 10 21:13:13.377684 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Domain-Id: None May 10 21:13:13.377684 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Domain-Name: None May 10 21:13:13.377684 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Identity-Status: Confirmed May 10 21:13:13.377684 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Is-Admin-Project: True May 10 21:13:13.377684 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Openstack-Nova-Api-Version: 2.90 May 10 21:13:13.377684 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Project-Domain-Id: default May 10 21:13:13.377684 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Project-Domain-Name: Default May 10 21:13:13.377684 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Project-Id: 3ea6acf0b7844ccca48ba57f57c13860 May 10 21:13:13.377684 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Project-Name: admin May 10 21:13:13.377684 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Role: admin,member,reader May 10 21:13:13.377684 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Roles: admin,member,reader May 10 21:13:13.379379 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ea6acf0b7844ccca48ba57f57c13860"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3ea6acf0b7844ccca48ba57f57c13860"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ea6acf0b7844ccca48ba57f57c13860"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3ea6acf0b7844ccca48ba57f57c13860"}]}] May 10 21:13:13.379379 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Tenant: admin May 10 21:13:13.379379 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Tenant-Id: 3ea6acf0b7844ccca48ba57f57c13860 May 10 21:13:13.379379 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Tenant-Name: admin May 10 21:13:13.379379 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-User: admin May 10 21:13:13.379379 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-User-Domain-Id: default May 10 21:13:13.379379 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-User-Domain-Name: Default May 10 21:13:13.379379 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-User-Id: 94be445c202a4e67aef3505af25af405 May 10 21:13:13.379379 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-User-Name: admin May 10 21:13:13.379379 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: method: > May 10 21:13:13.379379 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: exception: Flavor 84 could not be found. May 10 21:13:13.379379 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: action_args: {'id': '84'} May 10 21:13:13.379379 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:13:13.379379 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:13:13.380459 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 21:13:13.380459 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 21:13:13.380459 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 21:13:13.380459 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 21:13:13.380459 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 21:13:13.380459 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 21:13:13.380459 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 21:13:13.380459 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 21:13:13.380459 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 21:13:13.380459 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:13:13.380459 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 21:13:13.380459 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 21:13:13.380459 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 10 21:13:13.380459 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi May 10 21:13:13.380459 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:13:13.380459 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi May 10 21:13:13.380459 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:13:13.380459 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:13:13.380459 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:13:13.381838 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:13:13.381838 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:13:13.381838 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:13:13.381838 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:13:13.381838 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 21:13:13.381838 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 21:13:13.381838 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 10 21:13:13.381838 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi May 10 21:13:13.381838 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:13:13.381838 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi May 10 21:13:13.381838 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:13:13.381838 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:13:13.381838 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:13:13.381838 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:13:13.381838 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:13:13.381838 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 10 21:13:13.381838 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi May 10 21:13:13.381838 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-e255f406-5bfa-4e94-8a5e-4b7335fee8bd admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:13:13.383155 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-e255f406-5bfa-4e94-8a5e-4b7335fee8bd admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060488 May 10 21:13:13.383155 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 23/44] 10.222.0.25 () {60 vars in 1190 bytes} [Tue May 10 21:13:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 21:13:13.389061 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-d03ad5ed-d297-4585-b67d-49ac59038df5 admin admin] Calling method '>' {{(pid=103313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:13.403061 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: INFO nova.api.openstack.requestlog [None req-d03ad5ed-d297-4585-b67d-49ac59038df5 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017549 May 10 21:13:13.403513 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: [pid: 103313|app: 0|req: 22/45] 10.222.0.25 () {60 vars in 1210 bytes} [Tue May 10 21:13:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:13:13.413377 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-86864314-8cd9-4bab-8d53-2454332fa4b7 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:13.426616 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-86864314-8cd9-4bab-8d53-2454332fa4b7 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017233 May 10 21:13:13.427132 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 24/46] 10.222.0.25 () {60 vars in 1210 bytes} [Tue May 10 21:13:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:13:13.435916 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-fc65fe35-fd2f-411e-98aa-d2641f3d492f admin admin] Calling method '>' {{(pid=103313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:13.440919 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: INFO nova.api.openstack.wsgi [None req-fc65fe35-fd2f-411e-98aa-d2641f3d492f admin admin] HTTP exception thrown: Flavor 84 could not be found. May 10 21:13:13.442393 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-fc65fe35-fd2f-411e-98aa-d2641f3d492f admin admin] Request method failure captured: May 10 21:13:13.442393 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 10 21:13:13.442393 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: Accept: application/json May 10 21:13:13.442393 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: Accept-Encoding: gzip, deflate May 10 21:13:13.442393 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: Connection: keep-alive May 10 21:13:13.442393 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: Content-Length: 0 May 10 21:13:13.442393 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: Host: 10.222.0.25 May 10 21:13:13.442393 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: Openstack-Api-Version: compute 2.90 May 10 21:13:13.442393 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: Openstack-System-Scope: None May 10 21:13:13.442393 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: User-Agent: python-novaclient May 10 21:13:13.442393 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Auth-Token: gAAAAABietVp7oCHs-fRBpVkJQsN-dgw-IDqWHZjUzlERiaav0xmBDYTV7FFe4QwvgudRLPvHbW2hEbEIgaDRy1IMTFAgU5t_qQDKf5C4cfsPxWEeFao9Y7Cn5SczzWVCfEm0--SUpmFE-aHTv5QS2wZ7JgPcMCe-vsKYkko8tDS7KdZeYIuzD8 May 10 21:13:13.442393 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Domain-Id: None May 10 21:13:13.442393 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Domain-Name: None May 10 21:13:13.442393 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Identity-Status: Confirmed May 10 21:13:13.442393 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Is-Admin-Project: True May 10 21:13:13.442393 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Openstack-Nova-Api-Version: 2.90 May 10 21:13:13.442393 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Project-Domain-Id: default May 10 21:13:13.442393 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Project-Domain-Name: Default May 10 21:13:13.442393 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Project-Id: 3ea6acf0b7844ccca48ba57f57c13860 May 10 21:13:13.442393 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Project-Name: admin May 10 21:13:13.442393 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Role: admin,member,reader May 10 21:13:13.442393 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Roles: admin,member,reader May 10 21:13:13.443950 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ea6acf0b7844ccca48ba57f57c13860"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3ea6acf0b7844ccca48ba57f57c13860"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ea6acf0b7844ccca48ba57f57c13860"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3ea6acf0b7844ccca48ba57f57c13860"}]}] May 10 21:13:13.443950 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Tenant: admin May 10 21:13:13.443950 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Tenant-Id: 3ea6acf0b7844ccca48ba57f57c13860 May 10 21:13:13.443950 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Tenant-Name: admin May 10 21:13:13.443950 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-User: admin May 10 21:13:13.443950 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-User-Domain-Id: default May 10 21:13:13.443950 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-User-Domain-Name: Default May 10 21:13:13.443950 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-User-Id: 94be445c202a4e67aef3505af25af405 May 10 21:13:13.443950 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-User-Name: admin May 10 21:13:13.443950 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: method: > May 10 21:13:13.443950 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: exception: Flavor 84 could not be found. May 10 21:13:13.443950 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: action_args: {'id': '84'} May 10 21:13:13.443950 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: {{(pid=103313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:13:13.443950 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:13:13.444927 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 21:13:13.444927 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 21:13:13.444927 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 21:13:13.444927 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 21:13:13.444927 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 21:13:13.444927 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 21:13:13.444927 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 21:13:13.444927 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 21:13:13.444927 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 21:13:13.444927 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:13:13.444927 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 21:13:13.444927 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 21:13:13.444927 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 10 21:13:13.444927 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi May 10 21:13:13.444927 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:13:13.444927 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi May 10 21:13:13.444927 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:13:13.444927 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:13:13.444927 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:13:13.446186 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:13:13.446186 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:13:13.446186 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:13:13.446186 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:13:13.446186 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 21:13:13.446186 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 21:13:13.446186 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 10 21:13:13.446186 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi May 10 21:13:13.446186 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:13:13.446186 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi May 10 21:13:13.446186 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:13:13.446186 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:13:13.446186 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:13:13.446186 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:13:13.446186 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:13:13.446186 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 10 21:13:13.446186 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi May 10 21:13:13.446186 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-fc65fe35-fd2f-411e-98aa-d2641f3d492f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:13:13.448219 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: INFO nova.api.openstack.requestlog [None req-fc65fe35-fd2f-411e-98aa-d2641f3d492f admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011324 May 10 21:13:13.448219 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: [pid: 103313|app: 0|req: 23/47] 10.222.0.25 () {60 vars in 1190 bytes} [Tue May 10 21:13:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 10 21:13:14.344381 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-86864314-8cd9-4bab-8d53-2454332fa4b7 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:14.345397 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-86864314-8cd9-4bab-8d53-2454332fa4b7 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 May 10 21:13:14.345802 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 25/48] 10.222.0.25 () {56 vars in 1074 bytes} [Tue May 10 21:13:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:13:14.533108 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-918f4e57-a5bf-406e-a47e-83f75f69cb85 admin admin] Calling method '>' {{(pid=103313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:14.539241 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: INFO nova.api.openstack.wsgi [None req-918f4e57-a5bf-406e-a47e-83f75f69cb85 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 10 21:13:14.540728 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-918f4e57-a5bf-406e-a47e-83f75f69cb85 admin admin] Request method failure captured: May 10 21:13:14.540728 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 10 21:13:14.540728 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: Accept: application/json May 10 21:13:14.540728 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: Accept-Encoding: gzip, deflate May 10 21:13:14.540728 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: Connection: keep-alive May 10 21:13:14.540728 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: Content-Length: 0 May 10 21:13:14.540728 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: Host: 10.222.0.25 May 10 21:13:14.540728 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: Openstack-Api-Version: compute 2.90 May 10 21:13:14.540728 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: Openstack-System-Scope: None May 10 21:13:14.540728 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: User-Agent: python-novaclient May 10 21:13:14.540728 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Auth-Token: gAAAAABietVq6mzvlnU6REFPiIN-k283PcMEPebIS6jzO3V72NJK8pPrxA3RUcdljYo9F8XrKn1krhG138_5P57U8Ud_9scjpg8FLe81npEmXq5ZrFTRqYfHGY8miHt20Ou_uADY10xPre7Zrdz5dFm6QZHPfrU0k8qpz082CXDsALxpL66l1ww May 10 21:13:14.540728 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Domain-Id: None May 10 21:13:14.540728 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Domain-Name: None May 10 21:13:14.540728 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Identity-Status: Confirmed May 10 21:13:14.540728 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Is-Admin-Project: True May 10 21:13:14.540728 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Openstack-Nova-Api-Version: 2.90 May 10 21:13:14.540728 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Project-Domain-Id: default May 10 21:13:14.540728 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Project-Domain-Name: Default May 10 21:13:14.540728 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Project-Id: 3ea6acf0b7844ccca48ba57f57c13860 May 10 21:13:14.540728 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Project-Name: admin May 10 21:13:14.540728 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Role: admin,member,reader May 10 21:13:14.540728 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Roles: admin,member,reader May 10 21:13:14.542344 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ea6acf0b7844ccca48ba57f57c13860"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3ea6acf0b7844ccca48ba57f57c13860"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ea6acf0b7844ccca48ba57f57c13860"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3ea6acf0b7844ccca48ba57f57c13860"}]}] May 10 21:13:14.542344 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Tenant: admin May 10 21:13:14.542344 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Tenant-Id: 3ea6acf0b7844ccca48ba57f57c13860 May 10 21:13:14.542344 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-Tenant-Name: admin May 10 21:13:14.542344 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-User: admin May 10 21:13:14.542344 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-User-Domain-Id: default May 10 21:13:14.542344 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-User-Domain-Name: Default May 10 21:13:14.542344 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-User-Id: 94be445c202a4e67aef3505af25af405 May 10 21:13:14.542344 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: X-User-Name: admin May 10 21:13:14.542344 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: method: > May 10 21:13:14.542344 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: exception: Flavor 451 could not be found. May 10 21:13:14.542344 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: action_args: {'id': '451'} May 10 21:13:14.542344 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: {{(pid=103313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:13:14.542344 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:13:14.543240 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 21:13:14.543240 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 21:13:14.543240 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 21:13:14.543240 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 21:13:14.543240 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 21:13:14.543240 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 21:13:14.543240 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 21:13:14.543240 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 21:13:14.543240 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 21:13:14.543240 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:13:14.543240 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 21:13:14.543240 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 21:13:14.543240 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 10 21:13:14.543240 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi May 10 21:13:14.543240 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:13:14.543240 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi May 10 21:13:14.543240 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:13:14.543240 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:13:14.543240 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:13:14.544552 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:13:14.544552 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:13:14.544552 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:13:14.544552 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:13:14.544552 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 21:13:14.544552 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 21:13:14.544552 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 10 21:13:14.544552 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi May 10 21:13:14.544552 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:13:14.544552 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi May 10 21:13:14.544552 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:13:14.544552 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:13:14.544552 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:13:14.544552 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:13:14.544552 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:13:14.544552 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 10 21:13:14.544552 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: ERROR nova.api.openstack.wsgi May 10 21:13:14.544552 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-918f4e57-a5bf-406e-a47e-83f75f69cb85 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103313) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:13:14.545828 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: INFO nova.api.openstack.requestlog [None req-918f4e57-a5bf-406e-a47e-83f75f69cb85 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058730 May 10 21:13:14.545828 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: [pid: 103313|app: 0|req: 24/49] 10.222.0.25 () {60 vars in 1193 bytes} [Tue May 10 21:13:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 21:13:14.552126 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-06ac7bd9-6e98-4652-9982-da4dd9e6911f admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:14.565346 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-06ac7bd9-6e98-4652-9982-da4dd9e6911f admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017147 May 10 21:13:14.566732 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 26/50] 10.222.0.25 () {60 vars in 1210 bytes} [Tue May 10 21:13:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:13:14.575810 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-4c003f77-c57f-479c-b608-477c119c1767 admin admin] Calling method '>' {{(pid=103313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:14.589573 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: INFO nova.api.openstack.requestlog [None req-4c003f77-c57f-479c-b608-477c119c1767 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017248 May 10 21:13:14.590090 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: [pid: 103313|app: 0|req: 25/51] 10.222.0.25 () {60 vars in 1210 bytes} [Tue May 10 21:13:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:13:14.599022 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-84959e27-3c53-4d2c-b713-cd2e02e6a92f admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:14.604172 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.wsgi [None req-84959e27-3c53-4d2c-b713-cd2e02e6a92f admin admin] HTTP exception thrown: Flavor 451 could not be found. May 10 21:13:14.605691 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-84959e27-3c53-4d2c-b713-cd2e02e6a92f admin admin] Request method failure captured: May 10 21:13:14.605691 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 10 21:13:14.605691 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: Accept: application/json May 10 21:13:14.605691 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: Accept-Encoding: gzip, deflate May 10 21:13:14.605691 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: Connection: keep-alive May 10 21:13:14.605691 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: Content-Length: 0 May 10 21:13:14.605691 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: Host: 10.222.0.25 May 10 21:13:14.605691 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: Openstack-Api-Version: compute 2.90 May 10 21:13:14.605691 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: Openstack-System-Scope: None May 10 21:13:14.605691 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: User-Agent: python-novaclient May 10 21:13:14.605691 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Auth-Token: gAAAAABietVq6mzvlnU6REFPiIN-k283PcMEPebIS6jzO3V72NJK8pPrxA3RUcdljYo9F8XrKn1krhG138_5P57U8Ud_9scjpg8FLe81npEmXq5ZrFTRqYfHGY8miHt20Ou_uADY10xPre7Zrdz5dFm6QZHPfrU0k8qpz082CXDsALxpL66l1ww May 10 21:13:14.605691 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Domain-Id: None May 10 21:13:14.605691 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Domain-Name: None May 10 21:13:14.605691 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Identity-Status: Confirmed May 10 21:13:14.605691 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Is-Admin-Project: True May 10 21:13:14.605691 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Openstack-Nova-Api-Version: 2.90 May 10 21:13:14.605691 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Project-Domain-Id: default May 10 21:13:14.605691 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Project-Domain-Name: Default May 10 21:13:14.605691 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Project-Id: 3ea6acf0b7844ccca48ba57f57c13860 May 10 21:13:14.605691 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Project-Name: admin May 10 21:13:14.605691 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Role: admin,member,reader May 10 21:13:14.605691 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Roles: admin,member,reader May 10 21:13:14.607298 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ea6acf0b7844ccca48ba57f57c13860"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3ea6acf0b7844ccca48ba57f57c13860"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ea6acf0b7844ccca48ba57f57c13860"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3ea6acf0b7844ccca48ba57f57c13860"}]}] May 10 21:13:14.607298 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Tenant: admin May 10 21:13:14.607298 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Tenant-Id: 3ea6acf0b7844ccca48ba57f57c13860 May 10 21:13:14.607298 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-Tenant-Name: admin May 10 21:13:14.607298 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-User: admin May 10 21:13:14.607298 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-User-Domain-Id: default May 10 21:13:14.607298 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-User-Domain-Name: Default May 10 21:13:14.607298 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-User-Id: 94be445c202a4e67aef3505af25af405 May 10 21:13:14.607298 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: X-User-Name: admin May 10 21:13:14.607298 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: method: > May 10 21:13:14.607298 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: exception: Flavor 451 could not be found. May 10 21:13:14.607298 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: action_args: {'id': '451'} May 10 21:13:14.607298 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:13:14.607298 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:13:14.608386 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 21:13:14.608386 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 21:13:14.608386 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 21:13:14.608386 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 21:13:14.608386 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 21:13:14.608386 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 21:13:14.608386 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 21:13:14.608386 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 21:13:14.608386 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 21:13:14.608386 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:13:14.608386 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 21:13:14.608386 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 21:13:14.608386 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 10 21:13:14.608386 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi May 10 21:13:14.608386 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:13:14.608386 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi May 10 21:13:14.608386 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:13:14.608386 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:13:14.608386 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:13:14.609708 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:13:14.609708 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:13:14.609708 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:13:14.609708 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:13:14.609708 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 21:13:14.609708 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 21:13:14.609708 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 10 21:13:14.609708 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi May 10 21:13:14.609708 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:13:14.609708 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi May 10 21:13:14.609708 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:13:14.609708 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:13:14.609708 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:13:14.609708 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:13:14.609708 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:13:14.609708 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 10 21:13:14.609708 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: ERROR nova.api.openstack.wsgi May 10 21:13:14.609708 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-84959e27-3c53-4d2c-b713-cd2e02e6a92f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:13:14.611015 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-84959e27-3c53-4d2c-b713-cd2e02e6a92f admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011605 May 10 21:13:14.611015 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 27/52] 10.222.0.25 () {60 vars in 1193 bytes} [Tue May 10 21:13:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 21:13:15.492207 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-4c003f77-c57f-479c-b608-477c119c1767 admin admin] Calling method '>' {{(pid=103313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:15.493208 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: INFO nova.api.openstack.requestlog [None req-4c003f77-c57f-479c-b608-477c119c1767 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 May 10 21:13:15.493608 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: [pid: 103313|app: 0|req: 26/53] 10.222.0.25 () {56 vars in 1074 bytes} [Tue May 10 21:13:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:13:15.682526 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-f7f54dcb-4e3f-4884-a37d-cf3729ac03c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:13:15.771698 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-f7f54dcb-4e3f-4884-a37d-cf3729ac03c8 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.140589 May 10 21:13:15.772304 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 28/54] 10.222.0.25 () {64 vars in 1235 bytes} [Tue May 10 21:13:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:13:16.658767 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-4c003f77-c57f-479c-b608-477c119c1767 admin admin] Calling method '>' {{(pid=103313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:16.660385 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: INFO nova.api.openstack.requestlog [None req-4c003f77-c57f-479c-b608-477c119c1767 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002058 May 10 21:13:16.660781 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: [pid: 103313|app: 0|req: 27/55] 10.222.0.25 () {56 vars in 1074 bytes} [Tue May 10 21:13:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:13:16.848162 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-99103774-549d-4fb1-81b2-abb98e8b97c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:13:16.913251 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-99103774-549d-4fb1-81b2-abb98e8b97c1 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.116266 May 10 21:13:16.913798 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 29/56] 10.222.0.25 () {64 vars in 1235 bytes} [Tue May 10 21:13:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:13:17.820510 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-4c003f77-c57f-479c-b608-477c119c1767 admin admin] Calling method '>' {{(pid=103313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:17.821519 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: INFO nova.api.openstack.requestlog [None req-4c003f77-c57f-479c-b608-477c119c1767 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 May 10 21:13:17.821916 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: [pid: 103313|app: 0|req: 28/57] 10.222.0.25 () {56 vars in 1074 bytes} [Tue May 10 21:13:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:13:18.009549 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-c2ab8666-2939-43d7-98c2-041e6de1f864 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:13:18.085247 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-c2ab8666-2939-43d7-98c2-041e6de1f864 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.125774 May 10 21:13:18.085767 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 30/58] 10.222.0.25 () {64 vars in 1235 bytes} [Tue May 10 21:13:17 2022] POST /compute/v2.1/flavors => generated 407 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:13:18.970627 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-4c003f77-c57f-479c-b608-477c119c1767 admin admin] Calling method '>' {{(pid=103313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:18.971687 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: INFO nova.api.openstack.requestlog [None req-4c003f77-c57f-479c-b608-477c119c1767 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 May 10 21:13:18.972150 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: [pid: 103313|app: 0|req: 29/59] 10.222.0.25 () {56 vars in 1074 bytes} [Tue May 10 21:13:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:13:19.163721 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-dd67ff11-bb5b-488a-bd85-da0e35dc412b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:13:19.245601 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-dd67ff11-bb5b-488a-bd85-da0e35dc412b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.133467 May 10 21:13:19.246064 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 31/60] 10.222.0.25 () {64 vars in 1235 bytes} [Tue May 10 21:13:19 2022] POST /compute/v2.1/flavors => generated 409 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:13:20.141048 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-4c003f77-c57f-479c-b608-477c119c1767 admin admin] Calling method '>' {{(pid=103313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:20.142063 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: INFO nova.api.openstack.requestlog [None req-4c003f77-c57f-479c-b608-477c119c1767 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 May 10 21:13:20.142491 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: [pid: 103313|app: 0|req: 30/61] 10.222.0.25 () {56 vars in 1074 bytes} [Tue May 10 21:13:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:13:20.331629 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-946b8891-9175-4512-b24c-493483c3951a admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:20.350948 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-946b8891-9175-4512-b24c-493483c3951a admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070582 May 10 21:13:20.351422 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 32/62] 10.222.0.25 () {60 vars in 1202 bytes} [Tue May 10 21:13:20 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:14:22.971871 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-4c003f77-c57f-479c-b608-477c119c1767 admin admin] Calling method '>' {{(pid=103313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:22.972883 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: INFO nova.api.openstack.requestlog [None req-4c003f77-c57f-479c-b608-477c119c1767 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 May 10 21:14:22.973280 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: [pid: 103313|app: 0|req: 31/63] 10.222.0.25 () {54 vars in 930 bytes} [Tue May 10 21:14:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:23.032506 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-46523312-89a1-4e7b-a507-58162ce06f9c admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:23.052569 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-46523312-89a1-4e7b-a507-58162ce06f9c admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073250 May 10 21:14:23.053110 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 33/64] 10.222.0.25 () {60 vars in 1291 bytes} [Tue May 10 21:14:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:14:23.075904 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-5c2d0860-beaa-41a0-91d1-71b3c539ad1c admin admin] Calling method '>' {{(pid=103313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:23.084226 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: INFO nova.api.openstack.requestlog [None req-5c2d0860-beaa-41a0-91d1-71b3c539ad1c admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012640 May 10 21:14:23.084745 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: [pid: 103313|app: 0|req: 32/65] 10.222.0.25 () {60 vars in 1282 bytes} [Tue May 10 21:14:23 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:14:23.096370 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-8fd2ce13-f5a1-44fa-a222-94fc8c947e0e admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:23.103878 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-8fd2ce13-f5a1-44fa-a222-94fc8c947e0e admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011692 May 10 21:14:23.104402 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 34/66] 10.222.0.25 () {60 vars in 1285 bytes} [Tue May 10 21:14:23 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:14:23.116323 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-050ddbff-e686-4441-89d2-827d32378896 admin admin] Calling method '>' {{(pid=103313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:23.123655 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: INFO nova.api.openstack.requestlog [None req-050ddbff-e686-4441-89d2-827d32378896 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010861 May 10 21:14:23.124171 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: [pid: 103313|app: 0|req: 33/67] 10.222.0.25 () {60 vars in 1285 bytes} [Tue May 10 21:14:23 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:14:23.135973 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-8bd1e65b-209d-47c6-be1b-88491242b535 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:23.144212 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-8bd1e65b-209d-47c6-be1b-88491242b535 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011803 May 10 21:14:23.144742 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 35/68] 10.222.0.25 () {60 vars in 1282 bytes} [Tue May 10 21:14:23 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:18:08.527633 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-050ddbff-e686-4441-89d2-827d32378896 admin admin] Calling method '>' {{(pid=103313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:08.528689 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: INFO nova.api.openstack.requestlog [None req-050ddbff-e686-4441-89d2-827d32378896 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 May 10 21:18:08.529086 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: [pid: 103313|app: 0|req: 34/69] 10.222.0.25 () {56 vars in 1074 bytes} [Tue May 10 21:18:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:08.797636 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-97456c84-dd61-423f-982c-cddb5cbc4709 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:08.798848 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 21:18:08.798848 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: warnings.warn(msg) May 10 21:18:08.800038 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-97456c84-dd61-423f-982c-cddb5cbc4709 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:08.800475 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-97456c84-dd61-423f-982c-cddb5cbc4709 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:08.801280 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-97456c84-dd61-423f-982c-cddb5cbc4709 admin admin] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:08.801709 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-97456c84-dd61-423f-982c-cddb5cbc4709 admin admin] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:08.835203 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-97456c84-dd61-423f-982c-cddb5cbc4709 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.149128 May 10 21:18:08.835771 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 36/70] 10.222.0.25 () {60 vars in 1193 bytes} [Tue May 10 21:18:08 2022] GET /compute/v2.1/os-services => generated 791 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:09.738920 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-050ddbff-e686-4441-89d2-827d32378896 admin admin] Calling method '>' {{(pid=103313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:09.739958 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: INFO nova.api.openstack.requestlog [None req-050ddbff-e686-4441-89d2-827d32378896 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 May 10 21:18:09.740352 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: [pid: 103313|app: 0|req: 35/71] 10.222.0.25 () {56 vars in 1074 bytes} [Tue May 10 21:18:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:09.931757 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-3e999885-fbf0-4190-be6e-bbe90f1d1a48 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:09.932935 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 21:18:09.932935 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: warnings.warn(msg) May 10 21:18:09.934109 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-3e999885-fbf0-4190-be6e-bbe90f1d1a48 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:09.934608 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-3e999885-fbf0-4190-be6e-bbe90f1d1a48 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:09.935419 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-3e999885-fbf0-4190-be6e-bbe90f1d1a48 admin admin] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:09.935848 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-3e999885-fbf0-4190-be6e-bbe90f1d1a48 admin admin] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:09.955333 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-3e999885-fbf0-4190-be6e-bbe90f1d1a48 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075325 May 10 21:18:09.955818 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 37/72] 10.222.0.25 () {60 vars in 1193 bytes} [Tue May 10 21:18:09 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:21.255262 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-050ddbff-e686-4441-89d2-827d32378896 admin admin] Calling method '>' {{(pid=103313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:21.256268 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: INFO nova.api.openstack.requestlog [None req-050ddbff-e686-4441-89d2-827d32378896 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 May 10 21:18:21.256662 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: [pid: 103313|app: 0|req: 36/73] 10.222.0.25 () {56 vars in 1074 bytes} [Tue May 10 21:18:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:21.444532 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-35fc9b78-a88f-49d9-902a-56f7c3e1f05d admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:21.446875 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 21:18:21.446875 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: warnings.warn(msg) May 10 21:18:21.448086 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-35fc9b78-a88f-49d9-902a-56f7c3e1f05d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:21.448527 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-35fc9b78-a88f-49d9-902a-56f7c3e1f05d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:21.449309 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-35fc9b78-a88f-49d9-902a-56f7c3e1f05d admin admin] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:21.449739 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-35fc9b78-a88f-49d9-902a-56f7c3e1f05d admin admin] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:21.474388 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-35fc9b78-a88f-49d9-902a-56f7c3e1f05d admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.082633 May 10 21:18:21.474965 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 38/74] 10.222.0.25 () {60 vars in 1193 bytes} [Tue May 10 21:18:21 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:18:22.365216 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: DEBUG nova.api.openstack.wsgi [None req-050ddbff-e686-4441-89d2-827d32378896 admin admin] Calling method '>' {{(pid=103313) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:22.366229 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: INFO nova.api.openstack.requestlog [None req-050ddbff-e686-4441-89d2-827d32378896 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 May 10 21:18:22.366674 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: [pid: 103313|app: 0|req: 37/75] 10.222.0.25 () {56 vars in 1074 bytes} [Tue May 10 21:18:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:22.556384 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG nova.api.openstack.wsgi [None req-404dfd6c-9813-4cca-8ea0-201f746012c2 admin admin] Calling method '>' {{(pid=103314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:22.557577 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 21:18:22.557577 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: warnings.warn(msg) May 10 21:18:22.558795 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-404dfd6c-9813-4cca-8ea0-201f746012c2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:22.559230 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-404dfd6c-9813-4cca-8ea0-201f746012c2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:22.559999 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-404dfd6c-9813-4cca-8ea0-201f746012c2 admin admin] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:22.560423 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: DEBUG oslo_concurrency.lockutils [None req-404dfd6c-9813-4cca-8ea0-201f746012c2 admin admin] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:22.582274 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: INFO nova.api.openstack.requestlog [None req-404dfd6c-9813-4cca-8ea0-201f746012c2 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077003 May 10 21:18:22.582800 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: [pid: 103314|app: 0|req: 39/76] 10.222.0.25 () {60 vars in 1193 bytes} [Tue May 10 21:18:22 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:19:20.053572 dv-cinder-836083-6-iscsi devstack@n-api.service[103312]: Tue May 10 21:19:20 2022 - graceful shutdown triggered... May 10 21:19:20.053709 dv-cinder-836083-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 10 21:19:20.054587 dv-cinder-836083-6-iscsi devstack@n-api.service[103313]: Gracefully killing worker 1 (pid: 103313)... May 10 21:19:20.055032 dv-cinder-836083-6-iscsi devstack@n-api.service[103314]: Gracefully killing worker 2 (pid: 103314)... May 10 21:19:21.055378 dv-cinder-836083-6-iscsi devstack@n-api.service[103312]: worker 1 buried after 1 seconds May 10 21:19:21.055378 dv-cinder-836083-6-iscsi devstack@n-api.service[103312]: worker 2 buried after 1 seconds May 10 21:19:21.055378 dv-cinder-836083-6-iscsi devstack@n-api.service[103312]: goodbye to uWSGI. May 10 21:19:21.056929 dv-cinder-836083-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 10 21:19:21.057657 dv-cinder-836083-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 10 21:19:21.060387 dv-cinder-836083-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 10 21:19:21.076007 dv-cinder-836083-6-iscsi devstack@n-api.service[117657]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 10 21:19:21.096519 dv-cinder-836083-6-iscsi devstack@n-api.service[117657]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 21:19:21 2022] *** May 10 21:19:21.096519 dv-cinder-836083-6-iscsi devstack@n-api.service[117657]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 21:19:21.096519 dv-cinder-836083-6-iscsi devstack@n-api.service[117657]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 21:19:21.096519 dv-cinder-836083-6-iscsi devstack@n-api.service[117657]: nodename: dv-cinder-836083-6-iscsi May 10 21:19:21.096519 dv-cinder-836083-6-iscsi devstack@n-api.service[117657]: machine: x86_64 May 10 21:19:21.096519 dv-cinder-836083-6-iscsi devstack@n-api.service[117657]: clock source: unix May 10 21:19:21.096519 dv-cinder-836083-6-iscsi devstack@n-api.service[117657]: pcre jit disabled May 10 21:19:21.096519 dv-cinder-836083-6-iscsi devstack@n-api.service[117657]: detected number of CPU cores: 4 May 10 21:19:21.096519 dv-cinder-836083-6-iscsi devstack@n-api.service[117657]: current working directory: / May 10 21:19:21.097246 dv-cinder-836083-6-iscsi devstack@n-api.service[117657]: detected binary path: /usr/bin/uwsgi-core May 10 21:19:21.097246 dv-cinder-836083-6-iscsi devstack@n-api.service[117657]: your processes number limit is 47680 May 10 21:19:21.097246 dv-cinder-836083-6-iscsi devstack@n-api.service[117657]: your memory page size is 4096 bytes May 10 21:19:21.097246 dv-cinder-836083-6-iscsi devstack@n-api.service[117657]: detected max file descriptor number: 2048 May 10 21:19:21.097246 dv-cinder-836083-6-iscsi devstack@n-api.service[117657]: lock engine: pthread robust mutexes May 10 21:19:21.097246 dv-cinder-836083-6-iscsi devstack@n-api.service[117657]: thunder lock: enabled May 10 21:19:21.097246 dv-cinder-836083-6-iscsi devstack@n-api.service[117657]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 10 21:19:21.097246 dv-cinder-836083-6-iscsi devstack@n-api.service[117657]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 21:19:21.143699 dv-cinder-836083-6-iscsi devstack@n-api.service[117657]: Python main interpreter initialized at 0x559f4c5739c0 May 10 21:19:21.143699 dv-cinder-836083-6-iscsi devstack@n-api.service[117657]: python threads support enabled May 10 21:19:21.143699 dv-cinder-836083-6-iscsi devstack@n-api.service[117657]: your server socket listen backlog is limited to 100 connections May 10 21:19:21.143699 dv-cinder-836083-6-iscsi devstack@n-api.service[117657]: your mercy for graceful operations on workers is 90 seconds May 10 21:19:21.144163 dv-cinder-836083-6-iscsi devstack@n-api.service[117657]: mapped 403077 bytes (393 KB) for 2 cores May 10 21:19:21.144163 dv-cinder-836083-6-iscsi devstack@n-api.service[117657]: *** Operational MODE: preforking *** May 10 21:19:21.144398 dv-cinder-836083-6-iscsi devstack@n-api.service[117657]: *** uWSGI is running in multiple interpreter mode *** May 10 21:19:21.144398 dv-cinder-836083-6-iscsi devstack@n-api.service[117657]: spawned uWSGI master process (pid: 117657) May 10 21:19:21.144602 dv-cinder-836083-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 10 21:19:21.145291 dv-cinder-836083-6-iscsi devstack@n-api.service[117657]: spawned uWSGI worker 1 (pid: 117678, cores: 1) May 10 21:19:21.148936 dv-cinder-836083-6-iscsi devstack@n-api.service[117657]: spawned uWSGI worker 2 (pid: 117679, cores: 1) May 10 21:19:21.148936 dv-cinder-836083-6-iscsi devstack@n-api.service[117657]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 21:19:22.350575 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 21:19:22.377602 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 21:19:23.152088 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 21:19:23.152088 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: from cryptography.utils import int_from_bytes May 10 21:19:23.152415 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 21:19:23.152415 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: from cryptography.utils import int_from_bytes May 10 21:19:23.180765 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 21:19:23.180765 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: from cryptography.utils import int_from_bytes May 10 21:19:23.181080 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 21:19:23.181080 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: from cryptography.utils import int_from_bytes May 10 21:19:25.575759 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 21:19:25.576383 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 21:19:25.576686 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 21:19:25.576895 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 21:19:25.577160 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 21:19:25.577543 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.577875 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.578199 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.578550 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.578883 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.579200 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.579523 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.579843 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.580174 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.580441 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.580771 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.581084 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836083-6-iscsi {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.581410 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.581722 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.582035 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.582357 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.582687 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.583014 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.583322 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.583824 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.585293 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.585293 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.585293 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.585293 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.585639 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.585862 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.586098 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.586421 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.586757 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.587084 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.587470 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836083-6-iscsi {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.588330 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.588736 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.589050 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.589486 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.589786 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.590099 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.590418 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.590768 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.591096 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.591407 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.591731 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.592075 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.592374 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.592678 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.592988 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.593300 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.593622 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.593930 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.594237 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.594512 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.594826 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.595154 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.595477 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.595802 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.596055 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.596307 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.596629 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.596951 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.597262 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.597569 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.597874 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.598184 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.598521 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.598836 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.599144 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.599450 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.599772 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.600088 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.600413 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.600722 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.601043 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.601449 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.601698 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.602007 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.602348 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.602693 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.603003 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.603326 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.604219 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.604660 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.604982 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.605302 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.605626 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.605953 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.606264 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.606541 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.606853 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.607161 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.607484 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.607793 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.608100 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.608841 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.608841 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.609188 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.609374 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.609602 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.609911 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.610225 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.610548 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.610862 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.611170 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.611481 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.611805 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.612127 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.612436 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.612746 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.613052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.613362 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.613682 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.613990 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.614297 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.614643 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.614951 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.615265 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.615588 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.615894 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.616203 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.616523 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.616825 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.617150 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.617457 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.617777 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.618072 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.618376 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.618711 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.619083 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.621911 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.621911 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.621911 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.621911 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.621911 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.621911 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.621911 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.621911 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.623182 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.623182 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.623182 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.623182 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.623779 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.623779 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.624080 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.624227 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.624851 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.624851 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.625162 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.625429 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.625744 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.626058 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.626373 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.626719 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.627038 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.627371 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.627691 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.628010 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.628332 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.628644 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.628803 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 21:19:25.629301 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 21:19:25.629454 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.629454 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.629895 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 21:19:25.630079 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.630240 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 21:19:25.630388 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.630588 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 21:19:25.630746 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.630906 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.631058 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.631212 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.631368 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.631526 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.631683 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.631836 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.631991 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.632146 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.632291 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.632445 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.632602 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.632747 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.632901 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.633047 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.633190 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.633350 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.633512 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.633676 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.633834 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.633986 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.634131 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.634284 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836083-6-iscsi {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.634482 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.635035 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.635192 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.635339 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.635497 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.635659 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.635817 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.635967 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.636112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.636256 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.636407 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.636563 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.636716 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.636861 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.637069 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.637069 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.637467 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.637751 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.637922 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.638153 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.638331 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.638602 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.640664 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.641656 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.641831 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.642577 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.642740 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.642906 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.643055 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.643214 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.643214 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.643498 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.643673 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.643823 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.643979 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.644134 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.644287 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.644447 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.644600 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.644785 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836083-6-iscsi {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.644977 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.647072 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.647640 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.647824 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.647985 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.648152 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.648311 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.648467 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.648645 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.648800 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.648964 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.649117 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.649273 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.649419 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.649608 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.649758 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.649910 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.650062 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.650769 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.650946 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.651101 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.651255 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.652341 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.652700 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.652861 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.652861 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.653155 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.653317 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.653553 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.653713 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.653866 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.653866 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.654167 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.654167 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.654499 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.654654 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.654806 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.654959 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.655104 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.655104 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.655629 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.655791 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.655945 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.656099 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.656244 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.656395 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.656555 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.656718 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.656875 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.657020 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.657165 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.657318 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.657472 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.657624 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.657776 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.657921 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.658065 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.658222 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.658385 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.658587 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.658749 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.658902 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.659059 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.659211 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.659361 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.659361 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.659650 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.659795 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.659795 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.660080 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.660231 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.660393 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.660546 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.660692 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.660850 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.661001 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.661289 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.661471 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.661898 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.662062 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.662236 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.662590 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.662752 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.662908 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.663065 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.663219 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.663371 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.663530 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.663676 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.663822 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.663974 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.664129 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.664283 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.664447 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.664592 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.664736 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.664880 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.665035 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.665193 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.665340 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.665504 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.665880 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.666610 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.666767 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.667089 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.667255 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.667409 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.667569 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.667715 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.667878 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.668041 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.668188 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.668333 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.668477 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.668622 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.668767 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.668920 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.669073 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.669219 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.669363 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.669507 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.669660 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.669827 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.669974 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.670127 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.670279 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.670449 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.670620 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.670774 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.670947 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.670947 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.672108 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.672267 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.672428 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.672781 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.672948 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.673105 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.673257 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.673409 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.673568 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.673721 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.673872 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.674017 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.674179 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.674329 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.674522 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.674683 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.674830 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.674986 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.675138 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.675296 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.675451 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.675596 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.675969 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.676125 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.676272 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.676432 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.676578 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.676722 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.676955 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.677127 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.677288 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.677441 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.677709 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.677874 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.677874 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.678170 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.678315 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.678480 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.678633 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.678633 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.678920 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.679067 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.679223 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.679380 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.679533 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.679693 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.679839 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.679983 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.680127 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.680270 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.680414 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.680567 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.680759 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.680919 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.681065 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.681228 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.681380 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.681631 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.681865 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.682305 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.682305 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.682621 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.682969 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.683213 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.683371 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.683525 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.683679 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.683833 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.684004 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.684157 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.684314 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.684466 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.684621 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.684765 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.684924 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.685069 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.685213 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.685371 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.685517 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:19:25.685670 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.685848 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.686216 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.686378 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.686572 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.686728 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.686875 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.687033 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.687179 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.687324 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.687477 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.687637 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.687797 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.687961 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.688124 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.688282 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.688434 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.688635 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.688803 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.688963 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.689117 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.689269 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.689419 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.689569 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.689732 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.689894 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.690054 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.690217 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.690368 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.690622 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.690793 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.690946 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.691105 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.691258 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.691410 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.691569 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.691721 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.691879 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.692835 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.693105 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.693286 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.693451 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.693612 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.693771 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.694040 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.694206 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.694368 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.694368 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.694703 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.694854 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.695012 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.695164 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.695316 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.695492 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.695653 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.695804 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.695955 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.696324 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.696498 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.696662 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.696815 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.696965 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.697148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.697315 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.697483 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.697806 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.697983 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.698137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.698289 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.698289 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.698651 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.698814 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.698967 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.699118 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.699274 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.699426 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.699591 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.699751 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.699917 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.700076 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.700076 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.700376 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.700537 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.700696 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.700855 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.701006 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.701156 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.701320 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.701472 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.701653 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.702038 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.702243 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.702689 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.702844 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.702994 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.703248 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.703407 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.703574 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.703729 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.703879 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.704050 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.704309 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.704477 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.704649 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.704810 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.704970 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.705122 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.705279 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.705445 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.705604 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.705757 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.705915 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.706066 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.706431 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.706636 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.706800 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.706964 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.707122 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.707281 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.707434 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.707593 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.707746 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.707898 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.708048 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.708207 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.708893 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.709067 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.709220 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.709388 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.709560 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.709720 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.709885 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.710039 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.710190 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.710342 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.710545 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.710703 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.710868 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.711024 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.711024 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.711309 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.711460 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.711636 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.711798 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.711950 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.712236 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.712236 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.714130 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.714337 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.714617 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.714787 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.714955 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.715116 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.715273 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.715457 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.715611 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.715763 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.715913 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.716072 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.716231 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.716689 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.716853 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.717014 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.717174 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.717327 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.717487 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.717651 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.718407 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.718671 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.718836 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.718990 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.719151 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.719302 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.719454 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.719861 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.720034 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.720197 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.720350 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.720521 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.720687 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.720841 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.720993 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.721152 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.721304 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.721463 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.721627 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.721787 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.721947 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.722099 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.722269 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.722556 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.722906 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.723075 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.723229 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.723490 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.723650 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.723810 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.723971 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.724185 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.724457 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.724644 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.724910 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.725085 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.725239 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.725410 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.725663 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.725822 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.725973 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.726134 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.726296 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.726470 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.726877 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.727038 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.727201 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.727363 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.727523 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.727675 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.727840 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.727992 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.728150 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.728310 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.728557 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.728719 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.728880 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.729032 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.729191 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.729358 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.729510 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.729680 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.729989 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.730172 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.730337 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.730506 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.730665 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.731068 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.731225 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.731376 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.731538 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.731699 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.731857 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.731965 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.732042 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.732333 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.732495 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.732701 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.732947 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.733085 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.733936 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.734035 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.734140 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.734229 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.734323 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.734411 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.734568 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.734694 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.734790 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.734877 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.734984 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.735072 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.735158 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.735257 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.735363 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.735466 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.735466 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.735645 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.735734 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.735832 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.735927 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.736021 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.736109 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.736201 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.736296 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.736391 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.736478 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.736570 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.736665 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.737041 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.737208 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.737313 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.737411 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.737506 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.737601 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.737689 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.737789 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.737885 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.737979 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.738067 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.738160 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.738249 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.738354 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.738511 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.738603 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.738603 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.738773 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.738862 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.738963 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.739052 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.739138 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.739231 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.739327 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.739423 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.739511 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.739604 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.739704 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.739800 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.739887 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.739982 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.740069 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.740162 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.740248 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.740333 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.740418 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.740418 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.740626 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.740719 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.740812 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.740906 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.740994 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.741087 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.741182 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.741276 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.741363 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.741454 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.741550 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.741643 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.741731 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.741816 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.741901 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.742000 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.742099 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.742194 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.742289 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.742376 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.742488 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.742577 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.742695 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.742836 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.742949 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.743038 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.743124 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.743124 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.743291 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.743291 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.743445 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.743445 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.743602 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.743692 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.743767 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.743852 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.743852 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.744584 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.744706 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.744805 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.744901 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.744988 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.745112 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.745213 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.745301 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.745469 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.745560 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.745646 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.745744 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.745837 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.745931 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.746031 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.746119 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.746204 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.746300 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.746388 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.746505 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.746596 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.746688 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.746776 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.746869 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.747276 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.747380 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.747483 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.747578 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.747666 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.747752 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.747838 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.747937 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.748025 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.748117 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.748210 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.748297 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.748390 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.748390 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.748577 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.748671 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.748759 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.748845 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.748938 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.749040 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.749141 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.749235 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.749335 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.749423 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.749521 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.749660 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.749764 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.749853 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.749939 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.750026 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.750189 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.750279 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.750373 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.750541 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.750641 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.750738 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.750831 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.750831 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.750995 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.751160 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.751278 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.751392 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.751514 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.751628 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.751731 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.751830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.751919 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.752004 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.752089 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.752181 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.752269 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.752364 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.752459 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.752594 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.752725 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.752829 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.752986 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.753087 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.753215 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.753346 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.753467 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.753590 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.753713 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.753828 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.753828 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.754055 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.754191 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.754335 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.754494 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.754627 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.754750 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.754872 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.754985 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.755106 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.755245 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.755245 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.755467 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.755467 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.755685 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.755685 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.755910 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.756023 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.756144 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.756257 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.756377 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.756499 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.756620 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.756740 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.756861 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.756980 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.757454 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.757589 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.757719 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.757835 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.757973 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.758703 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.758846 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.758971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.759098 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.759204 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.759204 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.759373 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.759480 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.759570 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.760283 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.760376 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.760470 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.760558 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.760653 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.760749 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.760837 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.760923 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.761009 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.761102 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.761199 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.761395 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.761497 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.761585 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.761672 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.761765 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.761765 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.761937 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.762023 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.762108 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.762194 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.762289 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.762377 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.762480 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.762480 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.762639 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.762737 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.762838 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.762970 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.763084 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.763224 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.763331 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.763419 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.763518 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.763607 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.763734 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.763854 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.763976 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.764079 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.764175 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.764264 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.764387 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.764509 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.764648 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.764749 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.765089 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.765184 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.765271 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.765355 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.765511 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.765642 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.765757 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.765876 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.765991 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.766093 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.766188 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.766285 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.766372 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.766481 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.766583 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.766671 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.766757 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.766851 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.766851 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.767017 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.767111 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.767396 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.767540 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.767685 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.767808 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.767928 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.768050 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.768050 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.768050 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.768050 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.768050 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.768480 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.768567 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.768660 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.768660 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.768870 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.768870 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.769109 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.769200 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.769301 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.769396 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.769483 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.769576 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.769670 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.769757 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.769857 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.769952 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.770048 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.770151 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.770238 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.770332 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.770427 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.770588 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.770687 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.770776 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.770871 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.770958 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.771043 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.771136 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.771223 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.771315 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.771415 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.771510 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.771510 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.771682 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.771769 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.771855 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.771952 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.772040 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.772131 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.772218 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.772303 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.772388 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.772487 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.772574 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.772659 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.772659 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.772814 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.772900 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.772999 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.773087 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.773160 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.773232 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.773317 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.773416 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.773511 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.773606 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.773699 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.773792 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.773879 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.773977 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.774065 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.774151 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.774243 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.774331 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.774423 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.774625 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.774760 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.774941 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.775099 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.775283 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.775514 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.775615 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.775924 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.776022 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.776278 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.776373 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.776624 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.776733 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.776934 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.777037 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.777242 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.777371 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.777623 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.777863 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.777863 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.778042 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.778171 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.778276 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.778525 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.778645 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.778815 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.778917 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.779127 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.779234 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.779434 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.779529 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.779833 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.779965 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.780147 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.780256 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.780476 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.780598 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.780802 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.780909 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.781096 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.781193 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.781406 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.781501 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.781722 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.781824 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.782036 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.782131 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.782341 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.782459 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.782722 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.782869 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.783053 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.783185 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.783376 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.783497 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.783698 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.783800 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.784022 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.784125 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.784394 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.784551 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.784705 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.784873 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.785031 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.785217 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.785336 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.785553 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.785650 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.785888 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.785985 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.786221 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.786316 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.786560 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.786682 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.786885 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.786995 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.787199 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.787292 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.787597 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.787760 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.787899 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.788002 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.788137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.788316 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.788450 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.788633 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.788781 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.788949 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.789100 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.789280 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.789397 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.789607 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.789740 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.789933 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.790061 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.790241 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.790590 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.790746 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.790953 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.791052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.791306 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.791453 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.791787 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.791897 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.792103 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.792206 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.792423 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.792526 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.792734 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.792830 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.793063 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.793165 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.793377 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.793483 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.793692 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.793788 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.794014 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.794114 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.794329 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.794430 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.794672 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.794771 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.794988 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.795095 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.795310 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.795423 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.795629 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.795733 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.795943 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.796038 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.796270 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.796428 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.796579 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.796684 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.796885 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.796989 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.797192 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.797297 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.797513 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.797606 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.797820 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.797925 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.798132 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.798309 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.798461 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.798571 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.798774 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.798878 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.799082 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.799180 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.799393 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.799519 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.799711 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.799817 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.800012 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.800116 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.800328 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.800430 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.800639 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.800732 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.800955 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.801056 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.801268 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.801364 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.801573 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.801666 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.801896 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.801991 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.802207 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.802302 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.802531 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.802695 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.802839 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.802942 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.803143 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.803246 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.803484 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.803588 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.803787 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.803882 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.804109 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.804203 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.804425 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.804528 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.804754 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.804848 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.805066 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.805162 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.805399 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.805621 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.805718 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.805969 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.806064 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.806307 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.806416 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.807192 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.807403 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.807509 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.807793 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.807957 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.808111 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.808216 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.808418 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.808552 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.809063 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.809178 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.809282 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.809365 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.809440 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.809538 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.809627 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.809755 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.809912 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.810076 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.810214 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.810396 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.810558 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.810739 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.810912 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.811060 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.811240 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.811379 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.811555 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.811699 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.811865 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.812016 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.812173 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.812333 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.812477 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.812651 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.812819 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.812969 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.813126 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.813291 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.813460 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.813641 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.813780 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.813970 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.814102 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.814295 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.814429 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.814644 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.814867 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.814963 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.815194 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.815291 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.815515 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.815618 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.815833 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.815928 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.816149 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.816253 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.816466 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.816569 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.816781 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.816878 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.817098 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.817206 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.817415 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.817525 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.817727 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.817857 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.818049 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.818180 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.818365 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.818551 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.818708 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.818885 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.819204 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.819317 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.819538 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.819640 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.819878 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.820015 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.820183 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.820278 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.820496 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.820591 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.820813 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.820914 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.821127 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.821224 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.821440 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.821542 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.821757 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.821874 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.822066 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.834976 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.835090 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.835190 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.835278 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.835365 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.835464 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.835554 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.835646 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.835733 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.835733 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.835898 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.835987 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.835987 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.836155 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.836243 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.836342 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.836438 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.836525 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.836617 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.836704 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.836789 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.836874 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.836974 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.837068 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.837160 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.837331 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.837423 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.837519 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.837606 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.837722 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.837825 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.837900 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.838003 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.838162 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.838265 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.838343 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.838424 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.838541 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.838618 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.838701 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.838784 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.838858 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.838938 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.839020 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.839116 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.839199 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.839294 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.839383 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.839477 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.839569 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.839825 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.839915 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.840001 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.840087 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.840250 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.840368 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.840489 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.840606 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.840720 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.840822 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.840911 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.840911 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.841083 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.841177 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.841263 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.841348 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.841440 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.841541 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.841670 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.841784 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.841896 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.842016 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.842144 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.842144 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.842382 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.842382 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.842640 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.842640 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.842867 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.842991 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.843107 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.843227 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.843342 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.844060 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.844165 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.844254 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.844348 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.844444 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.844531 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.844626 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.844720 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.844814 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.844901 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.844995 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.845089 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.845185 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.845261 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.845261 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.845416 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.845416 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.845416 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.845416 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.845416 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.845416 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.845416 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.845416 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.846033 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.846033 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.846033 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.846257 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.846342 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.846452 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.846561 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.846561 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.846737 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.846825 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.846918 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.847011 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.847113 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.847201 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.847294 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.847382 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.847473 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.847568 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.847656 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.847741 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.847827 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.847912 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.848003 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.848104 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.848104 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.848270 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.848357 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.848489 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.848603 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.848707 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.848796 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.848888 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.848975 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.849061 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.849146 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.849239 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.849315 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.849315 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.849466 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.849558 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.849682 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.849927 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.850025 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.850120 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.850208 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.850294 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.850389 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.850898 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.850993 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 21:19:25.851089 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.851089 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.851089 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.851089 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.851089 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.851089 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.851089 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.851690 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.851690 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.851969 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.852288 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.852842 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.853184 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.854053 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.854415 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.854834 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.855149 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.855461 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.855774 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.856100 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.856417 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.856756 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.857105 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.857352 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.857666 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.857980 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.858298 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.858642 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.858949 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.859260 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.859571 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.859886 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.860202 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.860542 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.860864 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.861183 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.861500 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.861820 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.862132 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.862457 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.862773 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.863083 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.863400 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.863734 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.864043 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.864353 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.864781 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.865095 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.865416 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.865740 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.866052 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.866378 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.866745 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.870623 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.870623 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.870623 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.870623 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.870623 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.870623 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.870623 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.870623 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.871259 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.871259 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.871259 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.871524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.871838 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.872143 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.872451 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.872758 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.873066 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.873373 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.873681 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.873987 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.874311 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.874656 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.874948 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.875254 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.875558 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.875864 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.876005 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_db.sqlalchemy.engines [None req-c1c8137f-10eb-4742-ae21-99220a629880 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117679) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 21:19:25.876164 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.876472 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.876775 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.877082 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.877387 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.877689 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.878000 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.878338 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.878782 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.879090 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.879414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.879727 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.880054 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.880366 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.880693 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.881019 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.881339 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.881650 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.881985 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.882299 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.882634 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.882951 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.883265 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.883577 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.883891 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.884220 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.884546 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.885130 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.885528 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.885796 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.886122 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.886487 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.886781 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.887114 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.887431 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.887746 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.888068 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.888381 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.888695 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.889012 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.889332 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.889662 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.890259 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.890609 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.890940 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.891293 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.891607 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.891964 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.892285 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.892601 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.892915 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.893222 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:19:25.893468 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 21:19:25.917508 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_db.sqlalchemy.engines [None req-0dd9dc3a-2335-454d-92aa-bc204af86b14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117678) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 21:19:25.943727 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.context [None req-c1c8137f-10eb-4742-ae21-99220a629880 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),618a26cc-a7ee-4518-9a96-cde8a6bd82c4(cell1) {{(pid=117679) load_cells /opt/stack/nova/nova/context.py:464}} May 10 21:19:25.948399 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c1c8137f-10eb-4742-ae21-99220a629880 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:25.950123 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c1c8137f-10eb-4742-ae21-99220a629880 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:25.950961 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c1c8137f-10eb-4742-ae21-99220a629880 None None] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:25.952905 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c1c8137f-10eb-4742-ae21-99220a629880 None None] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:25.964426 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_db.sqlalchemy.engines [None req-c1c8137f-10eb-4742-ae21-99220a629880 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117679) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 21:19:25.966529 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_db.sqlalchemy.engines [None req-c1c8137f-10eb-4742-ae21-99220a629880 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117679) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 21:19:25.982189 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.context [None req-0dd9dc3a-2335-454d-92aa-bc204af86b14 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),618a26cc-a7ee-4518-9a96-cde8a6bd82c4(cell1) {{(pid=117678) load_cells /opt/stack/nova/nova/context.py:464}} May 10 21:19:25.986689 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0dd9dc3a-2335-454d-92aa-bc204af86b14 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:25.988283 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0dd9dc3a-2335-454d-92aa-bc204af86b14 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:25.989096 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0dd9dc3a-2335-454d-92aa-bc204af86b14 None None] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:25.991023 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0dd9dc3a-2335-454d-92aa-bc204af86b14 None None] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:26.002720 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_db.sqlalchemy.engines [None req-0dd9dc3a-2335-454d-92aa-bc204af86b14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117678) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 21:19:26.004008 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_db.sqlalchemy.engines [None req-0dd9dc3a-2335-454d-92aa-bc204af86b14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117678) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 21:19:26.131472 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_db.sqlalchemy.engines [None req-c1c8137f-10eb-4742-ae21-99220a629880 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117679) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 21:19:26.161389 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_db.sqlalchemy.engines [None req-0dd9dc3a-2335-454d-92aa-bc204af86b14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117678) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 21:19:26.459171 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: WARNING keystonemiddleware.auth_token [None req-c1c8137f-10eb-4742-ae21-99220a629880 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 21:19:26.467400 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: WARNING keystonemiddleware.auth_token [None req-c1c8137f-10eb-4742-ae21-99220a629880 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 21:19:26.489357 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: WARNING keystonemiddleware.auth_token [None req-0dd9dc3a-2335-454d-92aa-bc204af86b14 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 21:19:26.497113 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: WARNING keystonemiddleware.auth_token [None req-0dd9dc3a-2335-454d-92aa-bc204af86b14 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 21:19:26.825059 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: WARNING keystonemiddleware.auth_token [None req-c1c8137f-10eb-4742-ae21-99220a629880 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 21:19:26.831833 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: WARNING keystonemiddleware.auth_token [None req-c1c8137f-10eb-4742-ae21-99220a629880 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 21:19:26.837315 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559f4c5739c0 pid: 117679 (default app) May 10 21:19:26.846480 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: WARNING keystonemiddleware.auth_token [None req-0dd9dc3a-2335-454d-92aa-bc204af86b14 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 21:19:26.852527 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: WARNING keystonemiddleware.auth_token [None req-0dd9dc3a-2335-454d-92aa-bc204af86b14 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 21:19:26.858284 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559f4c5739c0 pid: 117678 (default app) May 10 21:20:10.208100 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-b366737c-a8a8-4d35-825d-3e2426afd9cc tempest-VolumesNegativeTest-67618363 tempest-VolumesNegativeTest-67618363-project] Action: 'create', calling method: .version_select at 0x7f7aec493280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1958757008", "metadata": {"Type": "work"}}} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:20:10.228936 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-b366737c-a8a8-4d35-825d-3e2426afd9cc tempest-VolumesNegativeTest-67618363 tempest-VolumesNegativeTest-67618363-project] Request method failure captured: May 10 21:20:10.228936 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 21:20:10.228936 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept: application/json May 10 21:20:10.228936 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept-Encoding: identity May 10 21:20:10.228936 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Connection: close May 10 21:20:10.228936 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Length: 122 May 10 21:20:10.228936 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Type: application/json May 10 21:20:10.228936 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Host: 10.222.0.25 May 10 21:20:10.228936 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Openstack-System-Scope: None May 10 21:20:10.228936 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: User-Agent: python-urllib3/1.26.9 May 10 21:20:10.228936 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Auth-Token: gAAAAABietcJrWGb2J9yVD1erUiRJ91hNE-jW-RPGH8d0WCoVDz75x2qhJYf9ypVclAmoLd2CK2LsVS1JaAryG9bg3QsIlA5H4wmZ0ylIqrfH-dDON8hs87cMWTMfj6d_OboyyGy3REi0r77DNGpODfb3ldQHnL_aR-mxHqAHyNR3TRQutB1Wzc May 10 21:20:10.228936 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Id: None May 10 21:20:10.228936 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Name: None May 10 21:20:10.228936 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Identity-Status: Confirmed May 10 21:20:10.228936 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Is-Admin-Project: True May 10 21:20:10.228936 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Id: default May 10 21:20:10.228936 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Name: Default May 10 21:20:10.228936 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Id: 4b41b310b0064ec08e06330c518f70b2 May 10 21:20:10.228936 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Name: tempest-VolumesNegativeTest-67618363 May 10 21:20:10.228936 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Role: member,reader May 10 21:20:10.228936 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Roles: member,reader May 10 21:20:10.230685 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b41b310b0064ec08e06330c518f70b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b41b310b0064ec08e06330c518f70b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b41b310b0064ec08e06330c518f70b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b41b310b0064ec08e06330c518f70b2"}]}] May 10 21:20:10.230685 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant: tempest-VolumesNegativeTest-67618363 May 10 21:20:10.230685 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Id: 4b41b310b0064ec08e06330c518f70b2 May 10 21:20:10.230685 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Name: tempest-VolumesNegativeTest-67618363 May 10 21:20:10.230685 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User: tempest-VolumesNegativeTest-67618363-project May 10 21:20:10.230685 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Id: default May 10 21:20:10.230685 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Name: Default May 10 21:20:10.230685 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Id: 657302f196854f7e91fe963884ca42dc May 10 21:20:10.230685 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Name: tempest-VolumesNegativeTest-67618363-project May 10 21:20:10.230685 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: May 10 21:20:10.230685 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1958757008", "metadata": {"Type": "work"}}} May 10 21:20:10.230685 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: method: May 10 21:20:10.230685 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 21:20:10.231808 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1958757008', 'metadata': {'Type': 'work'}}}} May 10 21:20:10.231808 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:20:10.231808 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:20:10.231808 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 21:20:10.231808 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 21:20:10.231808 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 21:20:10.231808 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise error May 10 21:20:10.231808 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 10 21:20:10.231808 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:10.231808 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 10 21:20:10.231808 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 21:20:10.231808 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:10.231808 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 21:20:10.231808 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi '#$%' May 10 21:20:10.231808 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:10.231808 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:20:10.231808 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:10.231808 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:20:10.231808 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:20:10.231808 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:20:10.231808 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:20:10.231808 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:20:10.234039 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 21:20:10.234039 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 21:20:10.234039 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:20:10.234039 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:20:10.234039 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 21:20:10.234039 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 21:20:10.234039 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 21:20:10.234039 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 21:20:10.234039 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 21:20:10.234039 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 21:20:10.234039 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 21:20:10.234039 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:10.234039 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:20:10.234039 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:10.234039 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:20:10.234039 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:20:10.234039 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:20:10.234039 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 21:20:10.234039 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 21:20:10.239138 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 21:20:10.239138 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:10.239138 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-b366737c-a8a8-4d35-825d-3e2426afd9cc tempest-VolumesNegativeTest-67618363 tempest-VolumesNegativeTest-67618363-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:20:10.239138 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-b366737c-a8a8-4d35-825d-3e2426afd9cc tempest-VolumesNegativeTest-67618363 tempest-VolumesNegativeTest-67618363-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.809668 May 10 21:20:10.239138 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 1/1] 10.222.0.25 () {60 vars in 1155 bytes} [Tue May 10 21:20:09 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 812 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 10 21:20:10.243202 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-9ea27caa-4f24-486d-9c46-908f9f26e264 tempest-VolumesNegativeTest-67618363 tempest-VolumesNegativeTest-67618363-project] Action: 'create', calling method: .version_select at 0x7f7aec3285e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2110612227", "metadata": {"Type": "work"}}} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:20:10.245891 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-9ea27caa-4f24-486d-9c46-908f9f26e264 tempest-VolumesNegativeTest-67618363 tempest-VolumesNegativeTest-67618363-project] Request method failure captured: May 10 21:20:10.245891 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 21:20:10.245891 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept: application/json May 10 21:20:10.245891 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept-Encoding: identity May 10 21:20:10.245891 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Connection: close May 10 21:20:10.245891 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Length: 120 May 10 21:20:10.245891 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Type: application/json May 10 21:20:10.245891 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Host: 10.222.0.25 May 10 21:20:10.245891 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Openstack-System-Scope: None May 10 21:20:10.245891 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: User-Agent: python-urllib3/1.26.9 May 10 21:20:10.245891 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Auth-Token: gAAAAABietcJrWGb2J9yVD1erUiRJ91hNE-jW-RPGH8d0WCoVDz75x2qhJYf9ypVclAmoLd2CK2LsVS1JaAryG9bg3QsIlA5H4wmZ0ylIqrfH-dDON8hs87cMWTMfj6d_OboyyGy3REi0r77DNGpODfb3ldQHnL_aR-mxHqAHyNR3TRQutB1Wzc May 10 21:20:10.245891 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Id: None May 10 21:20:10.245891 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Name: None May 10 21:20:10.245891 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Identity-Status: Confirmed May 10 21:20:10.245891 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Is-Admin-Project: True May 10 21:20:10.245891 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Id: default May 10 21:20:10.245891 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Name: Default May 10 21:20:10.245891 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Id: 4b41b310b0064ec08e06330c518f70b2 May 10 21:20:10.245891 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Name: tempest-VolumesNegativeTest-67618363 May 10 21:20:10.245891 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Role: member,reader May 10 21:20:10.245891 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Roles: member,reader May 10 21:20:10.247574 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b41b310b0064ec08e06330c518f70b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b41b310b0064ec08e06330c518f70b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b41b310b0064ec08e06330c518f70b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b41b310b0064ec08e06330c518f70b2"}]}] May 10 21:20:10.247574 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant: tempest-VolumesNegativeTest-67618363 May 10 21:20:10.247574 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Id: 4b41b310b0064ec08e06330c518f70b2 May 10 21:20:10.247574 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Name: tempest-VolumesNegativeTest-67618363 May 10 21:20:10.247574 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User: tempest-VolumesNegativeTest-67618363-project May 10 21:20:10.247574 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Id: default May 10 21:20:10.247574 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Name: Default May 10 21:20:10.247574 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Id: 657302f196854f7e91fe963884ca42dc May 10 21:20:10.247574 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Name: tempest-VolumesNegativeTest-67618363-project May 10 21:20:10.247574 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: May 10 21:20:10.247574 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2110612227", "metadata": {"Type": "work"}}} May 10 21:20:10.247574 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: method: May 10 21:20:10.247574 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 21:20:10.248582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2110612227', 'metadata': {'Type': 'work'}}}} May 10 21:20:10.248582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:20:10.248582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:20:10.248582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 21:20:10.248582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 21:20:10.248582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 21:20:10.248582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise error May 10 21:20:10.248582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 10 21:20:10.248582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:10.248582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 10 21:20:10.248582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 21:20:10.248582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:10.248582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 21:20:10.248582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi '0' May 10 21:20:10.248582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:10.248582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:20:10.248582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:10.248582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:20:10.248582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:20:10.248582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:20:10.248582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:20:10.248582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:20:10.250180 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 21:20:10.250180 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 21:20:10.250180 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:20:10.250180 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:20:10.250180 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 21:20:10.250180 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 21:20:10.250180 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 21:20:10.250180 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 21:20:10.250180 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 21:20:10.250180 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 21:20:10.250180 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 21:20:10.250180 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:10.250180 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:20:10.250180 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:10.250180 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:20:10.250180 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:20:10.250180 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:20:10.250180 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 21:20:10.250180 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 21:20:10.251548 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 21:20:10.251548 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:10.251548 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-9ea27caa-4f24-486d-9c46-908f9f26e264 tempest-VolumesNegativeTest-67618363 tempest-VolumesNegativeTest-67618363-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:20:10.251548 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-9ea27caa-4f24-486d-9c46-908f9f26e264 tempest-VolumesNegativeTest-67618363 tempest-VolumesNegativeTest-67618363-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012561 May 10 21:20:10.252215 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 2/2] 10.222.0.25 () {60 vars in 1155 bytes} [Tue May 10 21:20:10 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 10 21:20:10.266218 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-bcebc0ee-7bdf-4a9c-b915-74050fa21a5f tempest-VolumesNegativeTest-67618363 tempest-VolumesNegativeTest-67618363-project] Action: 'create', calling method: .version_select at 0x7f7aec4935e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-802629305", "metadata": {"Type": "work"}}} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:20:10.275414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-bcebc0ee-7bdf-4a9c-b915-74050fa21a5f tempest-VolumesNegativeTest-67618363 tempest-VolumesNegativeTest-67618363-project] Request method failure captured: May 10 21:20:10.275414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 21:20:10.275414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept: application/json May 10 21:20:10.275414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept-Encoding: identity May 10 21:20:10.275414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Connection: close May 10 21:20:10.275414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Length: 118 May 10 21:20:10.275414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Type: application/json May 10 21:20:10.275414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Host: 10.222.0.25 May 10 21:20:10.275414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Openstack-System-Scope: None May 10 21:20:10.275414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: User-Agent: python-urllib3/1.26.9 May 10 21:20:10.275414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Auth-Token: gAAAAABietcJrWGb2J9yVD1erUiRJ91hNE-jW-RPGH8d0WCoVDz75x2qhJYf9ypVclAmoLd2CK2LsVS1JaAryG9bg3QsIlA5H4wmZ0ylIqrfH-dDON8hs87cMWTMfj6d_OboyyGy3REi0r77DNGpODfb3ldQHnL_aR-mxHqAHyNR3TRQutB1Wzc May 10 21:20:10.275414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Id: None May 10 21:20:10.275414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Name: None May 10 21:20:10.275414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Identity-Status: Confirmed May 10 21:20:10.275414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Is-Admin-Project: True May 10 21:20:10.275414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Id: default May 10 21:20:10.275414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Name: Default May 10 21:20:10.275414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Id: 4b41b310b0064ec08e06330c518f70b2 May 10 21:20:10.275414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Name: tempest-VolumesNegativeTest-67618363 May 10 21:20:10.275414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Role: member,reader May 10 21:20:10.275414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Roles: member,reader May 10 21:20:10.276816 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b41b310b0064ec08e06330c518f70b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b41b310b0064ec08e06330c518f70b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b41b310b0064ec08e06330c518f70b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b41b310b0064ec08e06330c518f70b2"}]}] May 10 21:20:10.276816 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant: tempest-VolumesNegativeTest-67618363 May 10 21:20:10.276816 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Id: 4b41b310b0064ec08e06330c518f70b2 May 10 21:20:10.276816 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Name: tempest-VolumesNegativeTest-67618363 May 10 21:20:10.276816 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User: tempest-VolumesNegativeTest-67618363-project May 10 21:20:10.276816 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Id: default May 10 21:20:10.276816 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Name: Default May 10 21:20:10.276816 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Id: 657302f196854f7e91fe963884ca42dc May 10 21:20:10.276816 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Name: tempest-VolumesNegativeTest-67618363-project May 10 21:20:10.276816 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: May 10 21:20:10.276816 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-802629305", "metadata": {"Type": "work"}}} May 10 21:20:10.276816 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: method: May 10 21:20:10.276816 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 21:20:10.277600 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-802629305', 'metadata': {'Type': 'work'}}}} May 10 21:20:10.277600 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:20:10.277600 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:20:10.277600 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 21:20:10.277600 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 21:20:10.277600 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 21:20:10.277600 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise error May 10 21:20:10.277600 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 10 21:20:10.277600 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:10.277600 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 10 21:20:10.277600 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 21:20:10.277600 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:10.277600 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 21:20:10.277600 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi '' May 10 21:20:10.277600 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:10.277600 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:20:10.277600 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:10.277600 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:20:10.277600 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:20:10.277600 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:20:10.277600 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:20:10.277600 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:20:10.278971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 21:20:10.278971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 21:20:10.278971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:20:10.278971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:20:10.278971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 21:20:10.278971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 21:20:10.278971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 21:20:10.278971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 21:20:10.278971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 21:20:10.278971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 21:20:10.278971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 21:20:10.278971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:10.278971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:20:10.278971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:10.278971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:20:10.278971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:20:10.278971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:20:10.278971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 21:20:10.278971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 21:20:10.280031 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 21:20:10.280031 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:10.280031 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-bcebc0ee-7bdf-4a9c-b915-74050fa21a5f tempest-VolumesNegativeTest-67618363 tempest-VolumesNegativeTest-67618363-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:20:10.280031 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-bcebc0ee-7bdf-4a9c-b915-74050fa21a5f tempest-VolumesNegativeTest-67618363 tempest-VolumesNegativeTest-67618363-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.018195 May 10 21:20:10.281351 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 3/3] 10.222.0.25 () {60 vars in 1155 bytes} [Tue May 10 21:20:10 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 21:20:10.294281 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-43ac8ab3-20c6-4e3a-9c99-f73f553a4538 tempest-VolumesNegativeTest-67618363 tempest-VolumesNegativeTest-67618363-project] Calling method '.version_select at 0x7f7aec348280>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:10.390213 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-896ae394-1189-4284-a182-91b4a6749939 tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] Action: 'create', calling method: .version_select at 0x7f7aec492280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-802737086"}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:20:10.991111 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.wsgi [None req-43ac8ab3-20c6-4e3a-9c99-f73f553a4538 tempest-VolumesNegativeTest-67618363 tempest-VolumesNegativeTest-67618363-project] HTTP exception thrown: Volume tempest-invalid-810031479 could not be found. May 10 21:20:10.997519 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-43ac8ab3-20c6-4e3a-9c99-f73f553a4538 tempest-VolumesNegativeTest-67618363 tempest-VolumesNegativeTest-67618363-project] Request method failure captured: May 10 21:20:10.997519 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-810031479 HTTP/1.1 May 10 21:20:10.997519 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept: application/json May 10 21:20:10.997519 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept-Encoding: identity May 10 21:20:10.997519 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Connection: close May 10 21:20:10.997519 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Length: 0 May 10 21:20:10.997519 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Type: application/json May 10 21:20:10.997519 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Host: 10.222.0.25 May 10 21:20:10.997519 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Openstack-System-Scope: None May 10 21:20:10.997519 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: User-Agent: python-urllib3/1.26.9 May 10 21:20:10.997519 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Auth-Token: gAAAAABietcJrWGb2J9yVD1erUiRJ91hNE-jW-RPGH8d0WCoVDz75x2qhJYf9ypVclAmoLd2CK2LsVS1JaAryG9bg3QsIlA5H4wmZ0ylIqrfH-dDON8hs87cMWTMfj6d_OboyyGy3REi0r77DNGpODfb3ldQHnL_aR-mxHqAHyNR3TRQutB1Wzc May 10 21:20:10.997519 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Id: None May 10 21:20:10.997519 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Name: None May 10 21:20:10.997519 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Identity-Status: Confirmed May 10 21:20:10.997519 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Is-Admin-Project: True May 10 21:20:10.997519 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Id: default May 10 21:20:10.997519 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Name: Default May 10 21:20:10.997519 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Id: 4b41b310b0064ec08e06330c518f70b2 May 10 21:20:10.997519 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Name: tempest-VolumesNegativeTest-67618363 May 10 21:20:10.997519 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Role: member,reader May 10 21:20:10.997519 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Roles: member,reader May 10 21:20:10.999237 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b41b310b0064ec08e06330c518f70b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b41b310b0064ec08e06330c518f70b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b41b310b0064ec08e06330c518f70b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b41b310b0064ec08e06330c518f70b2"}]}] May 10 21:20:10.999237 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant: tempest-VolumesNegativeTest-67618363 May 10 21:20:10.999237 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Id: 4b41b310b0064ec08e06330c518f70b2 May 10 21:20:10.999237 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Name: tempest-VolumesNegativeTest-67618363 May 10 21:20:10.999237 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User: tempest-VolumesNegativeTest-67618363-project May 10 21:20:10.999237 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Id: default May 10 21:20:10.999237 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Name: Default May 10 21:20:10.999237 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Id: 657302f196854f7e91fe963884ca42dc May 10 21:20:10.999237 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Name: tempest-VolumesNegativeTest-67618363-project May 10 21:20:10.999237 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: method: May 10 21:20:10.999237 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: exception: Volume tempest-invalid-810031479 could not be found. May 10 21:20:10.999237 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: action_args: {'id': 'tempest-invalid-810031479'} May 10 21:20:10.999237 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:20:10.999237 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:20:11.000315 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 21:20:11.000315 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 21:20:11.000315 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 21:20:11.000315 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 21:20:11.000315 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 21:20:11.000315 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 21:20:11.000315 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 21:20:11.000315 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 21:20:11.000315 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 21:20:11.000315 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 21:20:11.000315 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:20:11.000315 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:20:11.000315 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:20:11.000315 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:20:11.000315 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-810031479 could not be found. (HTTP 404) (Request-ID: req-55ac7159-ae75-4a0c-b951-e687b6a11777) May 10 21:20:11.000315 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:11.000315 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:20:11.000315 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:11.000315 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:20:11.001894 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 21:20:11.001894 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 21:20:11.001894 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 21:20:11.001894 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 21:20:11.001894 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 21:20:11.001894 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 21:20:11.001894 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 21:20:11.001894 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 21:20:11.001894 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 21:20:11.001894 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 21:20:11.001894 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 21:20:11.001894 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 21:20:11.001894 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 21:20:11.001894 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 21:20:11.001894 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 21:20:11.001894 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 21:20:11.001894 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 21:20:11.001894 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 21:20:11.003278 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:20:11.003278 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:20:11.003278 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:20:11.003278 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:20:11.003278 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-810031479 could not be found. May 10 21:20:11.003278 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:11.003278 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:20:11.003278 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:11.003278 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:20:11.003278 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:20:11.003278 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:20:11.003278 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:20:11.003278 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:20:11.003278 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 21:20:11.003278 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 21:20:11.003278 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:20:11.003278 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:20:11.003278 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 21:20:11.003278 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:20:11.003278 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-810031479 could not be found. May 10 21:20:11.004738 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:11.004738 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:20:11.004738 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:11.004738 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:20:11.004738 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:20:11.004738 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:20:11.004738 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:20:11.004738 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:20:11.004738 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-810031479 could not be found. May 10 21:20:11.004738 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:11.004738 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-43ac8ab3-20c6-4e3a-9c99-f73f553a4538 tempest-VolumesNegativeTest-67618363 tempest-VolumesNegativeTest-67618363-project] Returning 404 to user: Volume tempest-invalid-810031479 could not be found. {{(pid=117678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:20:11.010887 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-43ac8ab3-20c6-4e3a-9c99-f73f553a4538 tempest-VolumesNegativeTest-67618363 tempest-VolumesNegativeTest-67618363-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/tempest-invalid-810031479" status: 404 len: 98 microversion: 2.1 time: 0.722720 May 10 21:20:11.011970 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 4/4] 10.222.0.25 () {58 vars in 1214 bytes} [Tue May 10 21:20:10 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-810031479 => generated 98 bytes in 729 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 21:20:11.031287 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-c173eb90-c418-46ec-ab9a-eba950f45fee tempest-VolumesNegativeTest-67618363 tempest-VolumesNegativeTest-67618363-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.013085 May 10 21:20:11.031868 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 5/5] 10.222.0.25 () {58 vars in 1139 bytes} [Tue May 10 21:20:11 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 10 21:20:11.056887 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-5848773b-dc6b-4746-96f5-64fa4769b0c2 tempest-VolumesNegativeTest-67618363 tempest-VolumesNegativeTest-67618363-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.014352 May 10 21:20:11.058742 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 6/6] 10.222.0.25 () {58 vars in 1136 bytes} [Tue May 10 21:20:11 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 10 21:20:11.078996 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-996eedcd-d3d7-4a70-9e5c-9c67be1251da tempest-VolumesNegativeTest-67618363 tempest-VolumesNegativeTest-67618363-project] Calling method '.version_select at 0x7f7aec2701f0>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:11.298194 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.wsgi [None req-996eedcd-d3d7-4a70-9e5c-9c67be1251da tempest-VolumesNegativeTest-67618363 tempest-VolumesNegativeTest-67618363-project] HTTP exception thrown: Volume 4d2ec37f-3951-45e7-880b-d3ca7a391335 could not be found. May 10 21:20:11.298194 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-996eedcd-d3d7-4a70-9e5c-9c67be1251da tempest-VolumesNegativeTest-67618363 tempest-VolumesNegativeTest-67618363-project] Request method failure captured: May 10 21:20:11.298194 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: request: DELETE /compute/v2.1/os-volumes/4d2ec37f-3951-45e7-880b-d3ca7a391335 HTTP/1.1 May 10 21:20:11.298194 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept: application/json May 10 21:20:11.298194 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept-Encoding: identity May 10 21:20:11.298194 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Connection: close May 10 21:20:11.298194 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Length: 0 May 10 21:20:11.298194 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Type: application/json May 10 21:20:11.298194 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Host: 10.222.0.25 May 10 21:20:11.298194 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Openstack-System-Scope: None May 10 21:20:11.298194 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: User-Agent: python-urllib3/1.26.9 May 10 21:20:11.298194 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Auth-Token: gAAAAABietcJrWGb2J9yVD1erUiRJ91hNE-jW-RPGH8d0WCoVDz75x2qhJYf9ypVclAmoLd2CK2LsVS1JaAryG9bg3QsIlA5H4wmZ0ylIqrfH-dDON8hs87cMWTMfj6d_OboyyGy3REi0r77DNGpODfb3ldQHnL_aR-mxHqAHyNR3TRQutB1Wzc May 10 21:20:11.298194 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Id: None May 10 21:20:11.298194 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Name: None May 10 21:20:11.298194 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Identity-Status: Confirmed May 10 21:20:11.298194 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Is-Admin-Project: True May 10 21:20:11.298194 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Id: default May 10 21:20:11.298194 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Name: Default May 10 21:20:11.298194 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Id: 4b41b310b0064ec08e06330c518f70b2 May 10 21:20:11.298194 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Name: tempest-VolumesNegativeTest-67618363 May 10 21:20:11.298194 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Role: member,reader May 10 21:20:11.298194 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Roles: member,reader May 10 21:20:11.300067 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b41b310b0064ec08e06330c518f70b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b41b310b0064ec08e06330c518f70b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b41b310b0064ec08e06330c518f70b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b41b310b0064ec08e06330c518f70b2"}]}] May 10 21:20:11.300067 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant: tempest-VolumesNegativeTest-67618363 May 10 21:20:11.300067 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Id: 4b41b310b0064ec08e06330c518f70b2 May 10 21:20:11.300067 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Name: tempest-VolumesNegativeTest-67618363 May 10 21:20:11.300067 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User: tempest-VolumesNegativeTest-67618363-project May 10 21:20:11.300067 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Id: default May 10 21:20:11.300067 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Name: Default May 10 21:20:11.300067 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Id: 657302f196854f7e91fe963884ca42dc May 10 21:20:11.300067 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Name: tempest-VolumesNegativeTest-67618363-project May 10 21:20:11.300067 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: method: May 10 21:20:11.300067 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: exception: Volume 4d2ec37f-3951-45e7-880b-d3ca7a391335 could not be found. May 10 21:20:11.300067 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: action_args: {'id': '4d2ec37f-3951-45e7-880b-d3ca7a391335'} May 10 21:20:11.300067 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:20:11.305458 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:20:11.305458 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 21:20:11.305458 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 21:20:11.305458 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 21:20:11.305458 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 21:20:11.305458 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 21:20:11.305458 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 21:20:11.305458 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 21:20:11.305458 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 21:20:11.305458 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 21:20:11.305458 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 21:20:11.305458 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:20:11.305458 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:20:11.305458 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:20:11.305458 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:20:11.305458 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4d2ec37f-3951-45e7-880b-d3ca7a391335 could not be found. (HTTP 404) (Request-ID: req-26b7bdfe-fd87-414c-a662-5c3d21a8ff90) May 10 21:20:11.305458 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:11.305458 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:20:11.305458 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:11.307277 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:20:11.307277 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 21:20:11.307277 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 21:20:11.307277 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 21:20:11.307277 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 21:20:11.307277 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 21:20:11.307277 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 21:20:11.307277 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 21:20:11.307277 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 21:20:11.307277 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 21:20:11.307277 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 21:20:11.307277 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 21:20:11.307277 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 21:20:11.307277 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 21:20:11.307277 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 21:20:11.307277 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 21:20:11.307277 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 21:20:11.307277 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 21:20:11.307277 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 21:20:11.308645 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:20:11.308645 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:20:11.308645 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:20:11.308645 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:20:11.308645 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4d2ec37f-3951-45e7-880b-d3ca7a391335 could not be found. May 10 21:20:11.308645 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:11.308645 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:20:11.308645 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:11.308645 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:20:11.308645 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:20:11.308645 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:20:11.308645 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:20:11.308645 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:20:11.308645 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 21:20:11.308645 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 21:20:11.308645 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:20:11.308645 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:20:11.308645 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 21:20:11.308645 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:20:11.310128 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4d2ec37f-3951-45e7-880b-d3ca7a391335 could not be found. May 10 21:20:11.310128 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:11.310128 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:20:11.310128 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:11.310128 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:20:11.310128 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:20:11.310128 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:20:11.310128 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:20:11.310128 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:20:11.310128 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4d2ec37f-3951-45e7-880b-d3ca7a391335 could not be found. May 10 21:20:11.310128 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:11.310128 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-996eedcd-d3d7-4a70-9e5c-9c67be1251da tempest-VolumesNegativeTest-67618363 tempest-VolumesNegativeTest-67618363-project] Returning 404 to user: Volume 4d2ec37f-3951-45e7-880b-d3ca7a391335 could not be found. {{(pid=117678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:20:11.310128 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-996eedcd-d3d7-4a70-9e5c-9c67be1251da tempest-VolumesNegativeTest-67618363 tempest-VolumesNegativeTest-67618363-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/4d2ec37f-3951-45e7-880b-d3ca7a391335" status: 404 len: 109 microversion: 2.1 time: 0.236772 May 10 21:20:11.310128 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 7/7] 10.222.0.25 () {58 vars in 1247 bytes} [Tue May 10 21:20:11 2022] DELETE /compute/v2.1/os-volumes/4d2ec37f-3951-45e7-880b-d3ca7a391335 => generated 109 bytes in 238 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:20:11.314386 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-11263898-b221-4d25-958d-6ed0427e1b89 tempest-VolumesNegativeTest-67618363 tempest-VolumesNegativeTest-67618363-project] Calling method '.version_select at 0x7f7aec270430>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:11.357924 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.wsgi [None req-11263898-b221-4d25-958d-6ed0427e1b89 tempest-VolumesNegativeTest-67618363 tempest-VolumesNegativeTest-67618363-project] HTTP exception thrown: Volume 4a56a9eb-896f-4911-b718-3045bf6d07d2 could not be found. May 10 21:20:11.359916 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-11263898-b221-4d25-958d-6ed0427e1b89 tempest-VolumesNegativeTest-67618363 tempest-VolumesNegativeTest-67618363-project] Request method failure captured: May 10 21:20:11.359916 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: request: GET /compute/v2.1/os-volumes/4a56a9eb-896f-4911-b718-3045bf6d07d2 HTTP/1.1 May 10 21:20:11.359916 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept: application/json May 10 21:20:11.359916 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept-Encoding: identity May 10 21:20:11.359916 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Connection: close May 10 21:20:11.359916 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Length: 0 May 10 21:20:11.359916 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Type: application/json May 10 21:20:11.359916 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Host: 10.222.0.25 May 10 21:20:11.359916 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Openstack-System-Scope: None May 10 21:20:11.359916 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: User-Agent: python-urllib3/1.26.9 May 10 21:20:11.359916 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Auth-Token: gAAAAABietcJrWGb2J9yVD1erUiRJ91hNE-jW-RPGH8d0WCoVDz75x2qhJYf9ypVclAmoLd2CK2LsVS1JaAryG9bg3QsIlA5H4wmZ0ylIqrfH-dDON8hs87cMWTMfj6d_OboyyGy3REi0r77DNGpODfb3ldQHnL_aR-mxHqAHyNR3TRQutB1Wzc May 10 21:20:11.359916 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Id: None May 10 21:20:11.359916 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Name: None May 10 21:20:11.359916 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Identity-Status: Confirmed May 10 21:20:11.359916 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Is-Admin-Project: True May 10 21:20:11.359916 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Id: default May 10 21:20:11.359916 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Name: Default May 10 21:20:11.359916 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Id: 4b41b310b0064ec08e06330c518f70b2 May 10 21:20:11.359916 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Name: tempest-VolumesNegativeTest-67618363 May 10 21:20:11.359916 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Role: member,reader May 10 21:20:11.359916 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Roles: member,reader May 10 21:20:11.361201 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b41b310b0064ec08e06330c518f70b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b41b310b0064ec08e06330c518f70b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b41b310b0064ec08e06330c518f70b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b41b310b0064ec08e06330c518f70b2"}]}] May 10 21:20:11.361201 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant: tempest-VolumesNegativeTest-67618363 May 10 21:20:11.361201 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Id: 4b41b310b0064ec08e06330c518f70b2 May 10 21:20:11.361201 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Name: tempest-VolumesNegativeTest-67618363 May 10 21:20:11.361201 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User: tempest-VolumesNegativeTest-67618363-project May 10 21:20:11.361201 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Id: default May 10 21:20:11.361201 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Name: Default May 10 21:20:11.361201 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Id: 657302f196854f7e91fe963884ca42dc May 10 21:20:11.361201 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Name: tempest-VolumesNegativeTest-67618363-project May 10 21:20:11.361201 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: method: May 10 21:20:11.361201 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: exception: Volume 4a56a9eb-896f-4911-b718-3045bf6d07d2 could not be found. May 10 21:20:11.361201 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: action_args: {'id': '4a56a9eb-896f-4911-b718-3045bf6d07d2'} May 10 21:20:11.361201 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:20:11.362204 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:20:11.362204 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 21:20:11.362204 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 21:20:11.362204 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 21:20:11.362204 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 21:20:11.362204 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 21:20:11.362204 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 21:20:11.362204 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 21:20:11.362204 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 21:20:11.362204 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 21:20:11.362204 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 21:20:11.362204 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:20:11.362204 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:20:11.362204 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:20:11.362204 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:20:11.362204 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4a56a9eb-896f-4911-b718-3045bf6d07d2 could not be found. (HTTP 404) (Request-ID: req-4919d4b0-dc21-4a93-a1f7-87e0f0bdbfde) May 10 21:20:11.362204 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:11.362204 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:20:11.362204 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:11.363640 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:20:11.363640 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 21:20:11.363640 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 21:20:11.363640 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 21:20:11.363640 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 21:20:11.363640 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 21:20:11.363640 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 21:20:11.363640 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 21:20:11.363640 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 21:20:11.363640 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 21:20:11.363640 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 21:20:11.363640 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 21:20:11.363640 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 21:20:11.363640 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 21:20:11.363640 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 21:20:11.363640 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 21:20:11.363640 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 21:20:11.363640 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 21:20:11.363640 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 21:20:11.364772 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:20:11.364772 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:20:11.364772 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:20:11.364772 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:20:11.364772 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4a56a9eb-896f-4911-b718-3045bf6d07d2 could not be found. May 10 21:20:11.364772 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:11.364772 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:20:11.364772 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:11.364772 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:20:11.364772 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:20:11.364772 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:20:11.364772 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:20:11.364772 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:20:11.364772 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 21:20:11.364772 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 21:20:11.364772 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:20:11.364772 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:20:11.364772 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 21:20:11.364772 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:20:11.365978 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4a56a9eb-896f-4911-b718-3045bf6d07d2 could not be found. May 10 21:20:11.365978 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:11.365978 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:20:11.365978 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:11.365978 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:20:11.365978 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:20:11.365978 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:20:11.365978 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:20:11.365978 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:20:11.365978 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4a56a9eb-896f-4911-b718-3045bf6d07d2 could not be found. May 10 21:20:11.365978 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:11.365978 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-11263898-b221-4d25-958d-6ed0427e1b89 tempest-VolumesNegativeTest-67618363 tempest-VolumesNegativeTest-67618363-project] Returning 404 to user: Volume 4a56a9eb-896f-4911-b718-3045bf6d07d2 could not be found. {{(pid=117678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:20:11.365978 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-11263898-b221-4d25-958d-6ed0427e1b89 tempest-VolumesNegativeTest-67618363 tempest-VolumesNegativeTest-67618363-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/4a56a9eb-896f-4911-b718-3045bf6d07d2" status: 404 len: 109 microversion: 2.1 time: 0.055411 May 10 21:20:11.365978 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 8/8] 10.222.0.25 () {58 vars in 1244 bytes} [Tue May 10 21:20:11 2022] GET /compute/v2.1/os-volumes/4a56a9eb-896f-4911-b718-3045bf6d07d2 => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:20:12.674086 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-896ae394-1189-4284-a182-91b4a6749939 tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.260165 May 10 21:20:12.675632 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 1/9] 10.222.0.25 () {60 vars in 1154 bytes} [Tue May 10 21:20:09 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3268 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 10 21:20:12.688612 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-21caf395-a5d3-4de7-a148-c1f43c68bff8 tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] Calling method '.version_select at 0x7f7aec2d2a60>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:12.779472 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-21caf395-a5d3-4de7-a148-c1f43c68bff8 tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/eae8a4fc-1ca1-4791-b141-0bc4b937e946" status: 200 len: 344 microversion: 2.1 time: 0.095231 May 10 21:20:12.786164 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 9/10] 10.222.0.25 () {58 vars in 1244 bytes} [Tue May 10 21:20:12 2022] GET /compute/v2.1/os-volumes/eae8a4fc-1ca1-4791-b141-0bc4b937e946 => generated 344 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:20:12.955429 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-d364afb8-1232-47c7-a9da-675f7491d92b tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1663415748", "imageRef": "2d72b3e0-7d02-481e-b5e6-17f44e8729d6", "flavorRef": "452", "networks": [{"uuid": "54ee8034-6d5b-4e39-9436-d9a8e6b309b1"}]}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:20:13.093389 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.network.neutron [None req-d364afb8-1232-47c7-a9da-675f7491d92b tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] validate_networks() for [('54ee8034-6d5b-4e39-9436-d9a8e6b309b1', None, None, None, None, None)] {{(pid=117679) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 21:20:13.804598 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-be830ab4-33a6-448f-9614-cc2ecd7a13c0 tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] Calling method '.version_select at 0x7f7aec2704c0>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:13.899976 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-be830ab4-33a6-448f-9614-cc2ecd7a13c0 tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/eae8a4fc-1ca1-4791-b141-0bc4b937e946" status: 200 len: 345 microversion: 2.1 time: 0.111501 May 10 21:20:13.900559 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 10/11] 10.222.0.25 () {58 vars in 1244 bytes} [Tue May 10 21:20:13 2022] GET /compute/v2.1/os-volumes/eae8a4fc-1ca1-4791-b141-0bc4b937e946 => generated 345 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:20:13.915380 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-54882038-bd00-41fa-a311-90c32a15ad08 tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] Action: 'create', calling method: .version_select at 0x7f7aec286280>, body: {"snapshot": {"volume_id": "eae8a4fc-1ca1-4791-b141-0bc4b937e946", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-845170753"}} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:20:14.692102 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-54882038-bd00-41fa-a311-90c32a15ad08 tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] 10.222.0.25 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.782860 May 10 21:20:14.699825 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 11/12] 10.222.0.25 () {60 vars in 1161 bytes} [Tue May 10 21:20:13 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:20:14.706545 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-16638cc1-a07c-470d-82ce-07c335677246 tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] Calling method '.version_select at 0x7f7aec286ee0>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:14.894255 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-16638cc1-a07c-470d-82ce-07c335677246 tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/fa2b65b5-e871-49bb-9f8c-b781bbe3fba2" status: 200 len: 286 microversion: 2.1 time: 0.192823 May 10 21:20:14.895712 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 12/13] 10.222.0.25 () {58 vars in 1250 bytes} [Tue May 10 21:20:14 2022] GET /compute/v2.1/os-snapshots/fa2b65b5-e871-49bb-9f8c-b781bbe3fba2 => generated 286 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:20:14.908651 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-99ac75bd-116f-462b-8da5-5dd4d05751d2 tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] Calling method '.version_select at 0x7f7aec2863a0>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:14.976870 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-99ac75bd-116f-462b-8da5-5dd4d05751d2 tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.074610 May 10 21:20:14.977432 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 13/14] 10.222.0.25 () {58 vars in 1139 bytes} [Tue May 10 21:20:14 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:20:14.999396 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-62c8899b-d92d-4cf3-9a4d-4bbf6939ee00 tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] Calling method '.version_select at 0x7f7aec270550>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:15.050302 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-62c8899b-d92d-4cf3-9a4d-4bbf6939ee00 tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/fa2b65b5-e871-49bb-9f8c-b781bbe3fba2" status: 200 len: 286 microversion: 2.1 time: 0.060400 May 10 21:20:15.050302 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 14/15] 10.222.0.25 () {58 vars in 1250 bytes} [Tue May 10 21:20:14 2022] GET /compute/v2.1/os-snapshots/fa2b65b5-e871-49bb-9f8c-b781bbe3fba2 => generated 286 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:20:15.336760 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-d364afb8-1232-47c7-a9da-675f7491d92b tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Flavor limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 21:20:15.336760 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-d364afb8-1232-47c7-a9da-675f7491d92b tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Image limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 21:20:15.336760 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-d364afb8-1232-47c7-a9da-675f7491d92b tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Flavor pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 21:20:15.338550 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-d364afb8-1232-47c7-a9da-675f7491d92b tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Image pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 21:20:15.339682 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-d364afb8-1232-47c7-a9da-675f7491d92b tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 21:20:15.368211 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d364afb8-1232-47c7-a9da-675f7491d92b tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:15.369241 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d364afb8-1232-47c7-a9da-675f7491d92b tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:15.370641 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d364afb8-1232-47c7-a9da-675f7491d92b tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:15.371378 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d364afb8-1232-47c7-a9da-675f7491d92b tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:15.423729 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-d364afb8-1232-47c7-a9da-675f7491d92b tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Getting quotas for project e738363e9f184b01a86d3459779cdfb4. Resources: {'cores', 'instances', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:20:15.436047 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-d364afb8-1232-47c7-a9da-675f7491d92b tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Getting quotas for user 250d6a26720a4416b62f5f7b2c646c80 and project e738363e9f184b01a86d3459779cdfb4. Resources: {'cores', 'instances', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:20:15.473081 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-d364afb8-1232-47c7-a9da-675f7491d92b tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Going to run 1 instances... {{(pid=117679) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 21:20:15.481004 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-d364afb8-1232-47c7-a9da-675f7491d92b tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] [instance: a840063f-5498-40c6-a89b-053d1db08ef8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d72b3e0-7d02-481e-b5e6-17f44e8729d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 21:20:15.717645 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-d364afb8-1232-47c7-a9da-675f7491d92b tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.906024 May 10 21:20:15.718585 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 2/16] 10.222.0.25 () {60 vars in 1146 bytes} [Tue May 10 21:20:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 21:20:15.730796 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-a363f332-68fe-470b-a9d7-180ccba2ad48 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:15.731763 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-a363f332-68fe-470b-a9d7-180ccba2ad48 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] [instance: a840063f-5498-40c6-a89b-053d1db08ef8] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:16.060564 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4bc53f0b-e8dc-449e-8fae-9f8b78c00332 tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] Calling method '.version_select at 0x7f7aeb9ff3a0>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:16.117903 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4bc53f0b-e8dc-449e-8fae-9f8b78c00332 tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/fa2b65b5-e871-49bb-9f8c-b781bbe3fba2" status: 200 len: 286 microversion: 2.1 time: 0.059345 May 10 21:20:16.117903 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 3/17] 10.222.0.25 () {58 vars in 1250 bytes} [Tue May 10 21:20:16 2022] GET /compute/v2.1/os-snapshots/fa2b65b5-e871-49bb-9f8c-b781bbe3fba2 => generated 286 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:20:16.124138 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-a363f332-68fe-470b-a9d7-180ccba2ad48 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250d6a26720a4416b62f5f7b2c646c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e738363e9f184b01a86d3459779cdfb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:16.147989 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-a363f332-68fe-470b-a9d7-180ccba2ad48 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] 10.222.0.25 "GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8" status: 200 len: 1215 microversion: 2.1 time: 0.421546 May 10 21:20:16.151886 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 15/18] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:15 2022] GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8 => generated 1215 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:20:17.128879 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-c6f110d2-2c9d-41a2-af58-5ee5deaf6df3 tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] Calling method '.version_select at 0x7f7aeb9ffaf0>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:17.176176 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-75aa09f1-ddc9-4027-b844-4fecb93d6f07 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:17.178914 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-75aa09f1-ddc9-4027-b844-4fecb93d6f07 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] [instance: a840063f-5498-40c6-a89b-053d1db08ef8] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:17.215164 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-c6f110d2-2c9d-41a2-af58-5ee5deaf6df3 tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/fa2b65b5-e871-49bb-9f8c-b781bbe3fba2" status: 200 len: 286 microversion: 2.1 time: 0.090940 May 10 21:20:17.215819 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 4/19] 10.222.0.25 () {58 vars in 1250 bytes} [Tue May 10 21:20:17 2022] GET /compute/v2.1/os-snapshots/fa2b65b5-e871-49bb-9f8c-b781bbe3fba2 => generated 286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:20:17.846513 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-75aa09f1-ddc9-4027-b844-4fecb93d6f07 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250d6a26720a4416b62f5f7b2c646c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e738363e9f184b01a86d3459779cdfb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:17.868680 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-75aa09f1-ddc9-4027-b844-4fecb93d6f07 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] 10.222.0.25 "GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8" status: 200 len: 1215 microversion: 2.1 time: 0.704307 May 10 21:20:17.873761 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 16/20] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:17 2022] GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8 => generated 1215 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:20:18.228388 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4b3ab20b-532e-402f-9849-69b7fab9517f tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] Calling method '.version_select at 0x7f7aec2ec280>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:18.311665 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4b3ab20b-532e-402f-9849-69b7fab9517f tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/fa2b65b5-e871-49bb-9f8c-b781bbe3fba2" status: 200 len: 287 microversion: 2.1 time: 0.088475 May 10 21:20:18.318349 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 5/21] 10.222.0.25 () {58 vars in 1250 bytes} [Tue May 10 21:20:18 2022] GET /compute/v2.1/os-snapshots/fa2b65b5-e871-49bb-9f8c-b781bbe3fba2 => generated 287 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:20:18.327974 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-69078a96-10a0-4626-9fc8-74dba60caea3 tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] Calling method '.version_select at 0x7f7aec254700>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:18.549575 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-69078a96-10a0-4626-9fc8-74dba60caea3 tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] 10.222.0.25 "DELETE /compute/v2.1/os-snapshots/fa2b65b5-e871-49bb-9f8c-b781bbe3fba2" status: 202 len: 0 microversion: 2.1 time: 0.225816 May 10 21:20:18.550142 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 17/22] 10.222.0.25 () {58 vars in 1253 bytes} [Tue May 10 21:20:18 2022] DELETE /compute/v2.1/os-snapshots/fa2b65b5-e871-49bb-9f8c-b781bbe3fba2 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 21:20:18.558748 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-84f645a3-7542-4789-a850-666ad307274c tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] Calling method '.version_select at 0x7f7aeb9ff820>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:18.639707 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-84f645a3-7542-4789-a850-666ad307274c tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/fa2b65b5-e871-49bb-9f8c-b781bbe3fba2" status: 200 len: 286 microversion: 2.1 time: 0.084722 May 10 21:20:18.644722 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 6/23] 10.222.0.25 () {58 vars in 1250 bytes} [Tue May 10 21:20:18 2022] GET /compute/v2.1/os-snapshots/fa2b65b5-e871-49bb-9f8c-b781bbe3fba2 => generated 286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:20:18.892178 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-47b0e22e-c724-4ca0-a76c-bc4630d0abcd tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:18.893280 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-47b0e22e-c724-4ca0-a76c-bc4630d0abcd tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] [instance: a840063f-5498-40c6-a89b-053d1db08ef8] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:18.905763 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-47b0e22e-c724-4ca0-a76c-bc4630d0abcd tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:18.906213 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-47b0e22e-c724-4ca0-a76c-bc4630d0abcd tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:18.924481 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-47b0e22e-c724-4ca0-a76c-bc4630d0abcd tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:18.925169 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-47b0e22e-c724-4ca0-a76c-bc4630d0abcd tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:19.354566 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-47b0e22e-c724-4ca0-a76c-bc4630d0abcd tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250d6a26720a4416b62f5f7b2c646c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e738363e9f184b01a86d3459779cdfb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:19.374103 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-47b0e22e-c724-4ca0-a76c-bc4630d0abcd tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] 10.222.0.25 "GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8" status: 200 len: 1219 microversion: 2.1 time: 0.486862 May 10 21:20:19.380350 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 18/24] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:18 2022] GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8 => generated 1219 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:19.653409 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-ebb1c4b3-26e3-42b2-bb4d-6d7c8aa43b6f tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] Calling method '.version_select at 0x7f7aeb9ff040>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:19.691678 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-ebb1c4b3-26e3-42b2-bb4d-6d7c8aa43b6f tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] HTTP exception thrown: Snapshot fa2b65b5-e871-49bb-9f8c-b781bbe3fba2 could not be found. May 10 21:20:19.696277 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-ebb1c4b3-26e3-42b2-bb4d-6d7c8aa43b6f tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] Request method failure captured: May 10 21:20:19.696277 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: request: GET /compute/v2.1/os-snapshots/fa2b65b5-e871-49bb-9f8c-b781bbe3fba2 HTTP/1.1 May 10 21:20:19.696277 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept: application/json May 10 21:20:19.696277 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity May 10 21:20:19.696277 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Connection: close May 10 21:20:19.696277 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Length: 0 May 10 21:20:19.696277 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Type: application/json May 10 21:20:19.696277 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Host: 10.222.0.25 May 10 21:20:19.696277 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None May 10 21:20:19.696277 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 May 10 21:20:19.696277 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABietcJBLgOHv5luz7QD7oRbEYv9Pr_1PthAK0VWrzfJ2rn4Ce9l9t3vdOzNlpzPJoo1CZDxPLGRifCJDL6mRW6mYhcPzwQGIkoM9wZfWH2e7G3FWqNRPb3QrCzUMJlcU_z04Xug7i8J7ZySYm2wgn5SGoDsEmsMtqgDkXWy9VpLDfzQRA May 10 21:20:19.696277 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Id: None May 10 21:20:19.696277 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Name: None May 10 21:20:19.696277 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed May 10 21:20:19.696277 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True May 10 21:20:19.696277 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default May 10 21:20:19.696277 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default May 10 21:20:19.696277 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Id: 56c9fbbebbd742198fe89c367ce3b8ae May 10 21:20:19.696277 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1805224381 May 10 21:20:19.696277 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Role: member,reader May 10 21:20:19.696277 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Roles: member,reader May 10 21:20:19.697442 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56c9fbbebbd742198fe89c367ce3b8ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_56c9fbbebbd742198fe89c367ce3b8ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56c9fbbebbd742198fe89c367ce3b8ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/56c9fbbebbd742198fe89c367ce3b8ae"}]}] May 10 21:20:19.697442 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1805224381 May 10 21:20:19.697442 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Id: 56c9fbbebbd742198fe89c367ce3b8ae May 10 21:20:19.697442 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1805224381 May 10 21:20:19.697442 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User: tempest-VolumesSnapshotsTestJSON-1805224381-project May 10 21:20:19.697442 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default May 10 21:20:19.697442 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default May 10 21:20:19.697442 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Id: 05834b48b8c94e7c97f730ae7cc2f587 May 10 21:20:19.697442 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1805224381-project May 10 21:20:19.697442 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: method: May 10 21:20:19.697442 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: exception: Snapshot fa2b65b5-e871-49bb-9f8c-b781bbe3fba2 could not be found. May 10 21:20:19.697442 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: action_args: {'id': 'fa2b65b5-e871-49bb-9f8c-b781bbe3fba2'} May 10 21:20:19.697442 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:20:19.698090 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:20:19.698090 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 10 21:20:19.698090 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 10 21:20:19.698090 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 10 21:20:19.698090 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 10 21:20:19.698090 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 10 21:20:19.698090 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 10 21:20:19.698090 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 21:20:19.698090 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 21:20:19.698090 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 21:20:19.698090 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 21:20:19.698090 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:20:19.698090 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:20:19.698090 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:20:19.698090 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:20:19.698090 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot fa2b65b5-e871-49bb-9f8c-b781bbe3fba2 could not be found. (HTTP 404) (Request-ID: req-2fbc84d8-63ab-497c-b032-67140b6b1f92) May 10 21:20:19.698090 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:20:19.698090 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:20:19.699011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:20:19.699011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:20:19.699011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 10 21:20:19.699011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 10 21:20:19.699011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 21:20:19.699011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 21:20:19.699011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 10 21:20:19.699011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 10 21:20:19.699011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 21:20:19.699011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 21:20:19.699011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 10 21:20:19.699011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 10 21:20:19.699011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 10 21:20:19.699011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 10 21:20:19.699011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 10 21:20:19.699011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 10 21:20:19.699011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 21:20:19.699011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 21:20:19.699011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 21:20:19.699918 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 21:20:19.699918 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:20:19.699918 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:20:19.699918 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:20:19.699918 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:20:19.699918 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot fa2b65b5-e871-49bb-9f8c-b781bbe3fba2 could not be found. May 10 21:20:19.699918 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:20:19.699918 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:20:19.699918 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:20:19.699918 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:20:19.699918 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:20:19.699918 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:20:19.699918 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:20:19.699918 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:20:19.699918 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 21:20:19.699918 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 21:20:19.699918 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:20:19.699918 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:20:19.699918 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 10 21:20:19.699918 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:20:19.700862 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot fa2b65b5-e871-49bb-9f8c-b781bbe3fba2 could not be found. May 10 21:20:19.700862 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:20:19.700862 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:20:19.700862 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:20:19.700862 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:20:19.700862 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:20:19.700862 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:20:19.700862 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:20:19.700862 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:20:19.700862 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot fa2b65b5-e871-49bb-9f8c-b781bbe3fba2 could not be found. May 10 21:20:19.700862 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:20:19.700862 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-ebb1c4b3-26e3-42b2-bb4d-6d7c8aa43b6f tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] Returning 404 to user: Snapshot fa2b65b5-e871-49bb-9f8c-b781bbe3fba2 could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:20:19.700862 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-ebb1c4b3-26e3-42b2-bb4d-6d7c8aa43b6f tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/fa2b65b5-e871-49bb-9f8c-b781bbe3fba2" status: 404 len: 111 microversion: 2.1 time: 0.048478 May 10 21:20:19.702489 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 7/25] 10.222.0.25 () {58 vars in 1250 bytes} [Tue May 10 21:20:19 2022] GET /compute/v2.1/os-snapshots/fa2b65b5-e871-49bb-9f8c-b781bbe3fba2 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:20:19.706911 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-4fd354b9-1bcf-4aa7-8bde-d7b00f884cda tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] Calling method '.version_select at 0x7f7aec1b5ee0>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:20.062099 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-4fd354b9-1bcf-4aa7-8bde-d7b00f884cda tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/eae8a4fc-1ca1-4791-b141-0bc4b937e946" status: 202 len: 0 microversion: 2.1 time: 0.355621 May 10 21:20:20.062099 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 19/26] 10.222.0.25 () {58 vars in 1247 bytes} [Tue May 10 21:20:19 2022] DELETE /compute/v2.1/os-volumes/eae8a4fc-1ca1-4791-b141-0bc4b937e946 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 21:20:20.078285 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-318ed6c5-e4ba-4a22-9cd7-0e116f904cfe tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] Calling method '.version_select at 0x7f7aeba105e0>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:20.216252 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-318ed6c5-e4ba-4a22-9cd7-0e116f904cfe tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/eae8a4fc-1ca1-4791-b141-0bc4b937e946" status: 200 len: 344 microversion: 2.1 time: 0.149960 May 10 21:20:20.217108 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 8/27] 10.222.0.25 () {58 vars in 1244 bytes} [Tue May 10 21:20:20 2022] GET /compute/v2.1/os-volumes/eae8a4fc-1ca1-4791-b141-0bc4b937e946 => generated 344 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:20:20.397268 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-38339665-d442-4e32-b3f4-80554a0c6c81 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:20.398029 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-38339665-d442-4e32-b3f4-80554a0c6c81 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] [instance: a840063f-5498-40c6-a89b-053d1db08ef8] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:20.406131 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-38339665-d442-4e32-b3f4-80554a0c6c81 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:20.420477 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-38339665-d442-4e32-b3f4-80554a0c6c81 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:20.423539 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-38339665-d442-4e32-b3f4-80554a0c6c81 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:20.423539 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-38339665-d442-4e32-b3f4-80554a0c6c81 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:20.604992 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-38339665-d442-4e32-b3f4-80554a0c6c81 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250d6a26720a4416b62f5f7b2c646c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e738363e9f184b01a86d3459779cdfb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:20.612504 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-38339665-d442-4e32-b3f4-80554a0c6c81 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] 10.222.0.25 "GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8" status: 200 len: 1267 microversion: 2.1 time: 0.219437 May 10 21:20:20.623406 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 20/28] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:20 2022] GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8 => generated 1267 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:21.231972 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-dcc2d7e8-67b0-4413-8bda-87240756fec6 tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] Calling method '.version_select at 0x7f7aeba10d30>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:21.371079 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-dcc2d7e8-67b0-4413-8bda-87240756fec6 tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] HTTP exception thrown: Volume eae8a4fc-1ca1-4791-b141-0bc4b937e946 could not be found. May 10 21:20:21.374411 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-dcc2d7e8-67b0-4413-8bda-87240756fec6 tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] Request method failure captured: May 10 21:20:21.374411 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: request: GET /compute/v2.1/os-volumes/eae8a4fc-1ca1-4791-b141-0bc4b937e946 HTTP/1.1 May 10 21:20:21.374411 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept: application/json May 10 21:20:21.374411 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity May 10 21:20:21.374411 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Connection: close May 10 21:20:21.374411 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Length: 0 May 10 21:20:21.374411 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Type: application/json May 10 21:20:21.374411 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Host: 10.222.0.25 May 10 21:20:21.374411 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None May 10 21:20:21.374411 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 May 10 21:20:21.374411 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABietcJBLgOHv5luz7QD7oRbEYv9Pr_1PthAK0VWrzfJ2rn4Ce9l9t3vdOzNlpzPJoo1CZDxPLGRifCJDL6mRW6mYhcPzwQGIkoM9wZfWH2e7G3FWqNRPb3QrCzUMJlcU_z04Xug7i8J7ZySYm2wgn5SGoDsEmsMtqgDkXWy9VpLDfzQRA May 10 21:20:21.374411 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Id: None May 10 21:20:21.374411 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Name: None May 10 21:20:21.374411 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed May 10 21:20:21.374411 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True May 10 21:20:21.374411 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default May 10 21:20:21.374411 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default May 10 21:20:21.374411 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Id: 56c9fbbebbd742198fe89c367ce3b8ae May 10 21:20:21.374411 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1805224381 May 10 21:20:21.374411 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Role: member,reader May 10 21:20:21.374411 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Roles: member,reader May 10 21:20:21.375460 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56c9fbbebbd742198fe89c367ce3b8ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_56c9fbbebbd742198fe89c367ce3b8ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56c9fbbebbd742198fe89c367ce3b8ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/56c9fbbebbd742198fe89c367ce3b8ae"}]}] May 10 21:20:21.375460 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1805224381 May 10 21:20:21.375460 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Id: 56c9fbbebbd742198fe89c367ce3b8ae May 10 21:20:21.375460 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1805224381 May 10 21:20:21.375460 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User: tempest-VolumesSnapshotsTestJSON-1805224381-project May 10 21:20:21.375460 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default May 10 21:20:21.375460 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default May 10 21:20:21.375460 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Id: 05834b48b8c94e7c97f730ae7cc2f587 May 10 21:20:21.375460 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1805224381-project May 10 21:20:21.375460 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: method: May 10 21:20:21.375460 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: exception: Volume eae8a4fc-1ca1-4791-b141-0bc4b937e946 could not be found. May 10 21:20:21.375460 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: action_args: {'id': 'eae8a4fc-1ca1-4791-b141-0bc4b937e946'} May 10 21:20:21.375460 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:20:21.376082 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:20:21.376082 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 21:20:21.376082 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 21:20:21.376082 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 21:20:21.376082 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 21:20:21.376082 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 21:20:21.376082 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 21:20:21.376082 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 21:20:21.376082 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 21:20:21.376082 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 21:20:21.376082 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 21:20:21.376082 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:20:21.376082 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:20:21.376082 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:20:21.376082 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:20:21.376082 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eae8a4fc-1ca1-4791-b141-0bc4b937e946 could not be found. (HTTP 404) (Request-ID: req-712d5fe7-6ec7-4e4d-a0b0-8e901a42ec9c) May 10 21:20:21.376082 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:20:21.376082 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:20:21.376082 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:20:21.377107 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:20:21.377107 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 21:20:21.377107 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 21:20:21.377107 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 21:20:21.377107 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 21:20:21.377107 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 21:20:21.377107 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 21:20:21.377107 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 21:20:21.377107 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 21:20:21.377107 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 21:20:21.377107 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 21:20:21.377107 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 21:20:21.377107 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 21:20:21.377107 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 21:20:21.377107 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 21:20:21.377107 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 21:20:21.377107 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 21:20:21.377107 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 21:20:21.377107 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 21:20:21.378916 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:20:21.378916 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:20:21.378916 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:20:21.378916 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:20:21.378916 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eae8a4fc-1ca1-4791-b141-0bc4b937e946 could not be found. May 10 21:20:21.378916 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:20:21.378916 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:20:21.378916 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:20:21.378916 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:20:21.378916 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:20:21.378916 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:20:21.378916 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:20:21.378916 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:20:21.378916 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 21:20:21.378916 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 21:20:21.378916 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:20:21.378916 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:20:21.378916 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 21:20:21.378916 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:20:21.380563 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eae8a4fc-1ca1-4791-b141-0bc4b937e946 could not be found. May 10 21:20:21.380563 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:20:21.380563 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:20:21.380563 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:20:21.380563 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:20:21.380563 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:20:21.380563 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:20:21.380563 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:20:21.380563 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:20:21.380563 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eae8a4fc-1ca1-4791-b141-0bc4b937e946 could not be found. May 10 21:20:21.380563 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:20:21.385378 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-dcc2d7e8-67b0-4413-8bda-87240756fec6 tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] Returning 404 to user: Volume eae8a4fc-1ca1-4791-b141-0bc4b937e946 could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:20:21.386495 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-dcc2d7e8-67b0-4413-8bda-87240756fec6 tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/eae8a4fc-1ca1-4791-b141-0bc4b937e946" status: 404 len: 109 microversion: 2.1 time: 0.159761 May 10 21:20:21.387655 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 9/29] 10.222.0.25 () {58 vars in 1244 bytes} [Tue May 10 21:20:21 2022] GET /compute/v2.1/os-volumes/eae8a4fc-1ca1-4791-b141-0bc4b937e946 => generated 109 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:20:21.406022 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-fc5fada2-8eee-4283-8fe8-d9a555e8d1b6 tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] Calling method '.version_select at 0x7f7aec1c8a60>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:21.481484 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.wsgi [None req-fc5fada2-8eee-4283-8fe8-d9a555e8d1b6 tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] HTTP exception thrown: Volume eae8a4fc-1ca1-4791-b141-0bc4b937e946 could not be found. May 10 21:20:21.483581 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-fc5fada2-8eee-4283-8fe8-d9a555e8d1b6 tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] Request method failure captured: May 10 21:20:21.483581 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: request: DELETE /compute/v2.1/os-volumes/eae8a4fc-1ca1-4791-b141-0bc4b937e946 HTTP/1.1 May 10 21:20:21.483581 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept: application/json May 10 21:20:21.483581 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept-Encoding: identity May 10 21:20:21.483581 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Connection: close May 10 21:20:21.483581 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Length: 0 May 10 21:20:21.483581 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Type: application/json May 10 21:20:21.483581 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Host: 10.222.0.25 May 10 21:20:21.483581 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Openstack-System-Scope: None May 10 21:20:21.483581 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: User-Agent: python-urllib3/1.26.9 May 10 21:20:21.483581 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Auth-Token: gAAAAABietcJBLgOHv5luz7QD7oRbEYv9Pr_1PthAK0VWrzfJ2rn4Ce9l9t3vdOzNlpzPJoo1CZDxPLGRifCJDL6mRW6mYhcPzwQGIkoM9wZfWH2e7G3FWqNRPb3QrCzUMJlcU_z04Xug7i8J7ZySYm2wgn5SGoDsEmsMtqgDkXWy9VpLDfzQRA May 10 21:20:21.483581 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Id: None May 10 21:20:21.483581 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Name: None May 10 21:20:21.483581 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Identity-Status: Confirmed May 10 21:20:21.483581 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Is-Admin-Project: True May 10 21:20:21.483581 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Id: default May 10 21:20:21.483581 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Name: Default May 10 21:20:21.483581 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Id: 56c9fbbebbd742198fe89c367ce3b8ae May 10 21:20:21.483581 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1805224381 May 10 21:20:21.483581 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Role: member,reader May 10 21:20:21.483581 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Roles: member,reader May 10 21:20:21.484827 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56c9fbbebbd742198fe89c367ce3b8ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_56c9fbbebbd742198fe89c367ce3b8ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56c9fbbebbd742198fe89c367ce3b8ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/56c9fbbebbd742198fe89c367ce3b8ae"}]}] May 10 21:20:21.484827 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1805224381 May 10 21:20:21.484827 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Id: 56c9fbbebbd742198fe89c367ce3b8ae May 10 21:20:21.484827 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1805224381 May 10 21:20:21.484827 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User: tempest-VolumesSnapshotsTestJSON-1805224381-project May 10 21:20:21.484827 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Id: default May 10 21:20:21.484827 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Name: Default May 10 21:20:21.484827 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Id: 05834b48b8c94e7c97f730ae7cc2f587 May 10 21:20:21.484827 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1805224381-project May 10 21:20:21.484827 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: method: May 10 21:20:21.484827 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: exception: Volume eae8a4fc-1ca1-4791-b141-0bc4b937e946 could not be found. May 10 21:20:21.484827 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: action_args: {'id': 'eae8a4fc-1ca1-4791-b141-0bc4b937e946'} May 10 21:20:21.484827 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:20:21.488422 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:20:21.488422 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 21:20:21.488422 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 21:20:21.488422 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 21:20:21.488422 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 21:20:21.488422 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 21:20:21.488422 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 21:20:21.488422 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 21:20:21.488422 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 21:20:21.488422 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 21:20:21.488422 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 21:20:21.488422 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:20:21.488422 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:20:21.488422 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:20:21.488422 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:20:21.488422 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eae8a4fc-1ca1-4791-b141-0bc4b937e946 could not be found. (HTTP 404) (Request-ID: req-8aee824e-f95b-43c4-b101-f20c3a838e25) May 10 21:20:21.488422 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:21.488422 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:20:21.488422 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:21.489562 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:20:21.489562 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 21:20:21.489562 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 21:20:21.489562 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 21:20:21.489562 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 21:20:21.489562 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 21:20:21.489562 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 21:20:21.489562 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 21:20:21.489562 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 21:20:21.489562 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 21:20:21.489562 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 21:20:21.489562 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 21:20:21.489562 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 21:20:21.489562 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 21:20:21.489562 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 21:20:21.489562 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 21:20:21.489562 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 21:20:21.489562 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 21:20:21.489562 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 21:20:21.490841 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:20:21.490841 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:20:21.490841 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:20:21.490841 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:20:21.490841 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eae8a4fc-1ca1-4791-b141-0bc4b937e946 could not be found. May 10 21:20:21.490841 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:21.490841 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:20:21.490841 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:21.490841 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:20:21.490841 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:20:21.490841 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:20:21.490841 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:20:21.490841 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:20:21.490841 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 21:20:21.490841 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 21:20:21.490841 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:20:21.490841 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:20:21.490841 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 21:20:21.490841 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:20:21.492316 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eae8a4fc-1ca1-4791-b141-0bc4b937e946 could not be found. May 10 21:20:21.492316 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:21.492316 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:20:21.492316 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:21.492316 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:20:21.492316 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:20:21.492316 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:20:21.492316 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:20:21.492316 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:20:21.492316 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eae8a4fc-1ca1-4791-b141-0bc4b937e946 could not be found. May 10 21:20:21.492316 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:20:21.492316 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-fc5fada2-8eee-4283-8fe8-d9a555e8d1b6 tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] Returning 404 to user: Volume eae8a4fc-1ca1-4791-b141-0bc4b937e946 could not be found. {{(pid=117678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:20:21.492316 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-fc5fada2-8eee-4283-8fe8-d9a555e8d1b6 tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/eae8a4fc-1ca1-4791-b141-0bc4b937e946" status: 404 len: 109 microversion: 2.1 time: 0.083159 May 10 21:20:21.492316 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 21/30] 10.222.0.25 () {58 vars in 1247 bytes} [Tue May 10 21:20:21 2022] DELETE /compute/v2.1/os-volumes/eae8a4fc-1ca1-4791-b141-0bc4b937e946 => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:20:21.493861 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-3b5bda67-dab3-453e-8100-8bac936f4da8 tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] Calling method '.version_select at 0x7f7aeba103a0>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:21.541882 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-3b5bda67-dab3-453e-8100-8bac936f4da8 tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] HTTP exception thrown: Volume eae8a4fc-1ca1-4791-b141-0bc4b937e946 could not be found. May 10 21:20:21.544520 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-3b5bda67-dab3-453e-8100-8bac936f4da8 tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] Request method failure captured: May 10 21:20:21.544520 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: request: GET /compute/v2.1/os-volumes/eae8a4fc-1ca1-4791-b141-0bc4b937e946 HTTP/1.1 May 10 21:20:21.544520 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept: application/json May 10 21:20:21.544520 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity May 10 21:20:21.544520 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Connection: close May 10 21:20:21.544520 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Length: 0 May 10 21:20:21.544520 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Type: application/json May 10 21:20:21.544520 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Host: 10.222.0.25 May 10 21:20:21.544520 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None May 10 21:20:21.544520 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 May 10 21:20:21.544520 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABietcJBLgOHv5luz7QD7oRbEYv9Pr_1PthAK0VWrzfJ2rn4Ce9l9t3vdOzNlpzPJoo1CZDxPLGRifCJDL6mRW6mYhcPzwQGIkoM9wZfWH2e7G3FWqNRPb3QrCzUMJlcU_z04Xug7i8J7ZySYm2wgn5SGoDsEmsMtqgDkXWy9VpLDfzQRA May 10 21:20:21.544520 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Id: None May 10 21:20:21.544520 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Name: None May 10 21:20:21.544520 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed May 10 21:20:21.544520 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True May 10 21:20:21.544520 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default May 10 21:20:21.544520 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default May 10 21:20:21.544520 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Id: 56c9fbbebbd742198fe89c367ce3b8ae May 10 21:20:21.544520 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1805224381 May 10 21:20:21.544520 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Role: member,reader May 10 21:20:21.544520 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Roles: member,reader May 10 21:20:21.545495 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56c9fbbebbd742198fe89c367ce3b8ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_56c9fbbebbd742198fe89c367ce3b8ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56c9fbbebbd742198fe89c367ce3b8ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/56c9fbbebbd742198fe89c367ce3b8ae"}]}] May 10 21:20:21.545495 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1805224381 May 10 21:20:21.545495 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Id: 56c9fbbebbd742198fe89c367ce3b8ae May 10 21:20:21.545495 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1805224381 May 10 21:20:21.545495 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User: tempest-VolumesSnapshotsTestJSON-1805224381-project May 10 21:20:21.545495 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default May 10 21:20:21.545495 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default May 10 21:20:21.545495 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Id: 05834b48b8c94e7c97f730ae7cc2f587 May 10 21:20:21.545495 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1805224381-project May 10 21:20:21.545495 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: method: May 10 21:20:21.545495 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: exception: Volume eae8a4fc-1ca1-4791-b141-0bc4b937e946 could not be found. May 10 21:20:21.545495 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: action_args: {'id': 'eae8a4fc-1ca1-4791-b141-0bc4b937e946'} May 10 21:20:21.545495 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:20:21.547441 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:20:21.547441 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 21:20:21.547441 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 21:20:21.547441 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 21:20:21.547441 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 21:20:21.547441 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 21:20:21.547441 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 21:20:21.547441 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 21:20:21.547441 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 21:20:21.547441 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 21:20:21.547441 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 21:20:21.547441 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:20:21.547441 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:20:21.547441 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:20:21.547441 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:20:21.547441 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eae8a4fc-1ca1-4791-b141-0bc4b937e946 could not be found. (HTTP 404) (Request-ID: req-f062d225-a33b-42c3-8264-647f9ee1d3da) May 10 21:20:21.547441 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:20:21.547441 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:20:21.547441 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:20:21.548299 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:20:21.548299 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 21:20:21.548299 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 21:20:21.548299 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 21:20:21.548299 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 21:20:21.548299 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 21:20:21.548299 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 21:20:21.548299 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 21:20:21.548299 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 21:20:21.548299 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 21:20:21.548299 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 21:20:21.548299 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 21:20:21.548299 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 21:20:21.548299 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 21:20:21.548299 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 21:20:21.548299 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 21:20:21.548299 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 21:20:21.548299 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 21:20:21.548299 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 21:20:21.549268 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:20:21.549268 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:20:21.549268 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:20:21.549268 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:20:21.549268 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eae8a4fc-1ca1-4791-b141-0bc4b937e946 could not be found. May 10 21:20:21.549268 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:20:21.549268 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:20:21.549268 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:20:21.549268 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:20:21.549268 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:20:21.549268 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:20:21.549268 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:20:21.549268 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:20:21.549268 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 21:20:21.549268 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 21:20:21.549268 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:20:21.549268 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:20:21.549268 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 21:20:21.549268 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:20:21.550140 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eae8a4fc-1ca1-4791-b141-0bc4b937e946 could not be found. May 10 21:20:21.550140 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:20:21.550140 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:20:21.550140 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:20:21.550140 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:20:21.550140 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:20:21.550140 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:20:21.550140 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:20:21.550140 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:20:21.550140 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eae8a4fc-1ca1-4791-b141-0bc4b937e946 could not be found. May 10 21:20:21.550140 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:20:21.550140 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-3b5bda67-dab3-453e-8100-8bac936f4da8 tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] Returning 404 to user: Volume eae8a4fc-1ca1-4791-b141-0bc4b937e946 could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:20:21.550140 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-3b5bda67-dab3-453e-8100-8bac936f4da8 tempest-VolumesSnapshotsTestJSON-1805224381 tempest-VolumesSnapshotsTestJSON-1805224381-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/eae8a4fc-1ca1-4791-b141-0bc4b937e946" status: 404 len: 109 microversion: 2.1 time: 0.055724 May 10 21:20:21.550140 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 10/31] 10.222.0.25 () {58 vars in 1244 bytes} [Tue May 10 21:20:21 2022] GET /compute/v2.1/os-volumes/eae8a4fc-1ca1-4791-b141-0bc4b937e946 => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:20:21.634308 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-38ace404-1a86-4c91-b17d-13e1aaf31a5e tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:21.635129 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-38ace404-1a86-4c91-b17d-13e1aaf31a5e tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] [instance: a840063f-5498-40c6-a89b-053d1db08ef8] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:21.648949 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-38ace404-1a86-4c91-b17d-13e1aaf31a5e tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:21.652260 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-38ace404-1a86-4c91-b17d-13e1aaf31a5e tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:21.652260 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-38ace404-1a86-4c91-b17d-13e1aaf31a5e tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:21.658639 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-38ace404-1a86-4c91-b17d-13e1aaf31a5e tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:21.949361 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-38ace404-1a86-4c91-b17d-13e1aaf31a5e tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250d6a26720a4416b62f5f7b2c646c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e738363e9f184b01a86d3459779cdfb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:21.994599 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-38ace404-1a86-4c91-b17d-13e1aaf31a5e tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] 10.222.0.25 "GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8" status: 200 len: 1273 microversion: 2.1 time: 0.366686 May 10 21:20:22.009846 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 22/32] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:21 2022] GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8 => generated 1273 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:23.019278 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-29a1052d-dbe4-48ae-98bc-6eac4d3a0169 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:23.025609 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-29a1052d-dbe4-48ae-98bc-6eac4d3a0169 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] [instance: a840063f-5498-40c6-a89b-053d1db08ef8] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:23.061299 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-29a1052d-dbe4-48ae-98bc-6eac4d3a0169 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:23.063721 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-29a1052d-dbe4-48ae-98bc-6eac4d3a0169 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:23.067713 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-29a1052d-dbe4-48ae-98bc-6eac4d3a0169 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:23.069680 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-29a1052d-dbe4-48ae-98bc-6eac4d3a0169 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:23.847709 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-29a1052d-dbe4-48ae-98bc-6eac4d3a0169 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250d6a26720a4416b62f5f7b2c646c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e738363e9f184b01a86d3459779cdfb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:23.879285 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-29a1052d-dbe4-48ae-98bc-6eac4d3a0169 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] 10.222.0.25 "GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8" status: 200 len: 1273 microversion: 2.1 time: 0.868857 May 10 21:20:23.879970 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 11/33] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:23 2022] GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8 => generated 1273 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:24.898360 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e4b9d520-c2e5-4877-b9fb-013643bfe447 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:24.899019 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-e4b9d520-c2e5-4877-b9fb-013643bfe447 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] [instance: a840063f-5498-40c6-a89b-053d1db08ef8] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:24.924349 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e4b9d520-c2e5-4877-b9fb-013643bfe447 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:24.927015 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e4b9d520-c2e5-4877-b9fb-013643bfe447 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:24.933627 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e4b9d520-c2e5-4877-b9fb-013643bfe447 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:24.937980 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e4b9d520-c2e5-4877-b9fb-013643bfe447 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:25.087151 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-1f2c5849-0d4a-4d33-b7de-37ae22d78978 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Action: 'create', calling method: .version_select at 0x7f7aec16c5e0>, body: {"keypair": {"name": "tempest-keypair-141967161", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtHv+/zWBi81lFRAw0KFSMq2TK8k2W/pMgVMeX5QPF6Nl/rd1jHtaoPMs8iwhejNa6c5Ojfveka1PEjqo4ul6gb860jvp0jEdtzYMA2Fk8ekLu4ZyOyoqMn9QlQ4gag+Q=="}} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:20:25.197101 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.quota [None req-1f2c5849-0d4a-4d33-b7de-37ae22d78978 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Getting quotas for project 604bb43d90e344d3a89838c6575d12c2. Resources: {'key_pairs'} {{(pid=117678) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:20:25.223343 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.quota [None req-1f2c5849-0d4a-4d33-b7de-37ae22d78978 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Getting quotas for user 05eb9dfc751a4b44a8d4d7a03138f0d4 and project 604bb43d90e344d3a89838c6575d12c2. Resources: {'key_pairs'} {{(pid=117678) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:20:25.384723 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-1f2c5849-0d4a-4d33-b7de-37ae22d78978 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.597325 May 10 21:20:25.386561 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 23/34] 10.222.0.25 () {60 vars in 1158 bytes} [Tue May 10 21:20:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:20:26.752129 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-e4b9d520-c2e5-4877-b9fb-013643bfe447 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250d6a26720a4416b62f5f7b2c646c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e738363e9f184b01a86d3459779cdfb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:26.756642 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-e4b9d520-c2e5-4877-b9fb-013643bfe447 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] 10.222.0.25 "GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8" status: 200 len: 1315 microversion: 2.1 time: 1.863157 May 10 21:20:26.758104 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 12/35] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:24 2022] GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8 => generated 1315 bytes in 1865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:27.778825 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-c02331ba-33c6-4c24-8d03-426fa4f0fc56 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:27.779452 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-c02331ba-33c6-4c24-8d03-426fa4f0fc56 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] [instance: a840063f-5498-40c6-a89b-053d1db08ef8] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:27.821693 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c02331ba-33c6-4c24-8d03-426fa4f0fc56 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:27.825712 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c02331ba-33c6-4c24-8d03-426fa4f0fc56 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:27.830545 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c02331ba-33c6-4c24-8d03-426fa4f0fc56 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:27.837075 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c02331ba-33c6-4c24-8d03-426fa4f0fc56 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:28.515583 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-c02331ba-33c6-4c24-8d03-426fa4f0fc56 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250d6a26720a4416b62f5f7b2c646c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e738363e9f184b01a86d3459779cdfb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:28.529332 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-c02331ba-33c6-4c24-8d03-426fa4f0fc56 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] 10.222.0.25 "GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8" status: 200 len: 1315 microversion: 2.1 time: 0.757907 May 10 21:20:28.539930 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 24/36] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:27 2022] GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8 => generated 1315 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:29.552226 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-2f0fc4fa-13c9-4dc8-aedf-2bea0cc5a5c1 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:29.553507 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-2f0fc4fa-13c9-4dc8-aedf-2bea0cc5a5c1 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] [instance: a840063f-5498-40c6-a89b-053d1db08ef8] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:29.562940 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2f0fc4fa-13c9-4dc8-aedf-2bea0cc5a5c1 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:29.564291 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2f0fc4fa-13c9-4dc8-aedf-2bea0cc5a5c1 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:29.571742 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2f0fc4fa-13c9-4dc8-aedf-2bea0cc5a5c1 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:29.574373 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2f0fc4fa-13c9-4dc8-aedf-2bea0cc5a5c1 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:29.833911 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-f43829c3-206e-4199-9862-53093bad79fc tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Action: 'create', calling method: .version_select at 0x7f7aeb0aba60>, body: {"keypair": {"name": "tempest-keypair-565096298", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHx6J2gpuKHL0owTBLIiJkovftHNjRgw9WIY9o5ob5TIPcBBLUo29f63wAlJO4aABOWcUJ+HwQaB69FpD0UClyT7NZvQWsT69j7bpAXeisDXDXYRMXZV7vKWC+IeiLwtOQ=="}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:20:29.892951 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-f43829c3-206e-4199-9862-53093bad79fc tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Getting quotas for project 8286226c580f4896aec72c65642fce30. Resources: {'key_pairs'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:20:29.900879 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-f43829c3-206e-4199-9862-53093bad79fc tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Getting quotas for user ca39678abe6e476283f94c675d4ea369 and project 8286226c580f4896aec72c65642fce30. Resources: {'key_pairs'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:20:30.075106 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-f43829c3-206e-4199-9862-53093bad79fc tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.317339 May 10 21:20:30.076058 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 13/37] 10.222.0.25 () {60 vars in 1158 bytes} [Tue May 10 21:20:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:20:30.937035 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-2f0fc4fa-13c9-4dc8-aedf-2bea0cc5a5c1 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250d6a26720a4416b62f5f7b2c646c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e738363e9f184b01a86d3459779cdfb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:30.942292 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-2f0fc4fa-13c9-4dc8-aedf-2bea0cc5a5c1 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] 10.222.0.25 "GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8" status: 200 len: 1315 microversion: 2.1 time: 1.399573 May 10 21:20:30.957314 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 25/38] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:29 2022] GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8 => generated 1315 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:31.043460 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-0eb52c0d-acc3-40c6-9d42-998a25e81391 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1770867311", "imageRef": "2d72b3e0-7d02-481e-b5e6-17f44e8729d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:20:31.169387 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.network.neutron [None req-0eb52c0d-acc3-40c6-9d42-998a25e81391 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] validate_networks() for [('f4d68030-42b4-44a7-8e2e-1f92daeefa7f', None, None, None, None, None)] {{(pid=117679) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 21:20:31.978879 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-c76a65fc-a5ed-4217-8a1d-d2832165993d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Action: 'create', calling method: .version_select at 0x7f7aeb8a5940>, body: {"keypair": {"name": "tempest-keypair-163365215", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcRUiTtOsBI4sYfdsCgherQkDpX8H8YQZIp4atiSbKW1XwibGFflZKnvmvUtBBKintfq4XyF/GhhjIfctXxJtkLAAhX4slbx/bdU6QnRTgR8Y2Thm9tIiUQGqGydp8TjQ=="}} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:20:32.002541 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.quota [None req-c76a65fc-a5ed-4217-8a1d-d2832165993d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Getting quotas for project 802e2ef29f6f4b2c8ca69204b69cc142. Resources: {'key_pairs'} {{(pid=117678) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:20:32.009710 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.quota [None req-c76a65fc-a5ed-4217-8a1d-d2832165993d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Getting quotas for user d2267b0c3311480eb8d1f54df5296c4c and project 802e2ef29f6f4b2c8ca69204b69cc142. Resources: {'key_pairs'} {{(pid=117678) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:20:32.109809 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-c76a65fc-a5ed-4217-8a1d-d2832165993d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.273336 May 10 21:20:32.110757 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 26/39] 10.222.0.25 () {62 vars in 1199 bytes} [Tue May 10 21:20:31 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 275 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 10 21:20:32.117399 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-f78002f0-7dad-4b09-8dea-e23a18a5d323 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:32.120866 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-f78002f0-7dad-4b09-8dea-e23a18a5d323 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] [instance: a840063f-5498-40c6-a89b-053d1db08ef8] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:32.142714 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f78002f0-7dad-4b09-8dea-e23a18a5d323 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:32.152381 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f78002f0-7dad-4b09-8dea-e23a18a5d323 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:32.152381 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f78002f0-7dad-4b09-8dea-e23a18a5d323 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:32.152381 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f78002f0-7dad-4b09-8dea-e23a18a5d323 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:32.971589 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-0eb52c0d-acc3-40c6-9d42-998a25e81391 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Flavor limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 21:20:32.972163 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-0eb52c0d-acc3-40c6-9d42-998a25e81391 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Image limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 21:20:32.972355 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-f78002f0-7dad-4b09-8dea-e23a18a5d323 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250d6a26720a4416b62f5f7b2c646c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e738363e9f184b01a86d3459779cdfb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:32.972471 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-0eb52c0d-acc3-40c6-9d42-998a25e81391 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Flavor pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 21:20:32.972847 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-0eb52c0d-acc3-40c6-9d42-998a25e81391 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Image pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 21:20:32.973308 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-0eb52c0d-acc3-40c6-9d42-998a25e81391 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 21:20:32.986952 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-f78002f0-7dad-4b09-8dea-e23a18a5d323 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] 10.222.0.25 "GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8" status: 200 len: 1315 microversion: 2.1 time: 0.875089 May 10 21:20:32.987505 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 27/40] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:32 2022] GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8 => generated 1315 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:32.997351 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0eb52c0d-acc3-40c6-9d42-998a25e81391 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:32.998637 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0eb52c0d-acc3-40c6-9d42-998a25e81391 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:32.999903 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0eb52c0d-acc3-40c6-9d42-998a25e81391 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:33.000935 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0eb52c0d-acc3-40c6-9d42-998a25e81391 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:33.085007 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-0eb52c0d-acc3-40c6-9d42-998a25e81391 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Getting quotas for project 78072ca90bf6402b83863597c266a178. Resources: {'cores', 'instances', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:20:33.097237 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-0eb52c0d-acc3-40c6-9d42-998a25e81391 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Getting quotas for user 02af0eded57547f489be63cd6dc09399 and project 78072ca90bf6402b83863597c266a178. Resources: {'cores', 'instances', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:20:33.135180 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-0eb52c0d-acc3-40c6-9d42-998a25e81391 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Going to run 1 instances... {{(pid=117679) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 21:20:33.146778 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-0eb52c0d-acc3-40c6-9d42-998a25e81391 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d72b3e0-7d02-481e-b5e6-17f44e8729d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 21:20:33.395779 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-0eb52c0d-acc3-40c6-9d42-998a25e81391 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.635488 May 10 21:20:33.409536 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 14/41] 10.222.0.25 () {60 vars in 1146 bytes} [Tue May 10 21:20:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 2646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 21:20:33.416231 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-93cf58d3-c81e-448d-bf01-d34f6ee60435 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:33.418239 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-93cf58d3-c81e-448d-bf01-d34f6ee60435 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:33.937467 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-93cf58d3-c81e-448d-bf01-d34f6ee60435 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:33.979024 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-93cf58d3-c81e-448d-bf01-d34f6ee60435 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad" status: 200 len: 1222 microversion: 2.1 time: 0.549249 May 10 21:20:33.983734 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 28/42] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:33 2022] GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad => generated 1222 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:34.008788 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-75d47221-8e4d-4fca-8d86-924ce1674925 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:34.009628 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-75d47221-8e4d-4fca-8d86-924ce1674925 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] [instance: a840063f-5498-40c6-a89b-053d1db08ef8] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:34.067379 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-75d47221-8e4d-4fca-8d86-924ce1674925 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:34.070534 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-75d47221-8e4d-4fca-8d86-924ce1674925 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:34.073397 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-75d47221-8e4d-4fca-8d86-924ce1674925 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:34.080109 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-75d47221-8e4d-4fca-8d86-924ce1674925 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:34.303062 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-417775aa-cdca-49c9-bef3-0c18cc34cf98 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-266223230", "imageRef": "2d72b3e0-7d02-481e-b5e6-17f44e8729d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:20:34.616499 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.network.neutron [None req-417775aa-cdca-49c9-bef3-0c18cc34cf98 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] validate_networks() for [('f4d68030-42b4-44a7-8e2e-1f92daeefa7f', None, None, None, None, None)] {{(pid=117678) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 21:20:35.481296 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-75d47221-8e4d-4fca-8d86-924ce1674925 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250d6a26720a4416b62f5f7b2c646c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e738363e9f184b01a86d3459779cdfb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:35.502623 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-75d47221-8e4d-4fca-8d86-924ce1674925 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] 10.222.0.25 "GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8" status: 200 len: 1315 microversion: 2.1 time: 1.499088 May 10 21:20:35.503224 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 15/43] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:34 2022] GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8 => generated 1315 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:35.647799 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-e23b119b-62fe-4a55-80e8-63b6879fe147 req-eeee0721-a86b-4b68-a719-622e1f66849b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a840063f-5498-40c6-a89b-053d1db08ef8", "tag": "7cc3e14f-fcea-4e69-a7c4-1e231eb42d7c"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:20:35.661775 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-e23b119b-62fe-4a55-80e8-63b6879fe147 req-eeee0721-a86b-4b68-a719-622e1f66849b service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:35.662902 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-e23b119b-62fe-4a55-80e8-63b6879fe147 req-eeee0721-a86b-4b68-a719-622e1f66849b service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:35.701315 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-e23b119b-62fe-4a55-80e8-63b6879fe147 req-eeee0721-a86b-4b68-a719-622e1f66849b service nova] Creating event network-changed:7cc3e14f-fcea-4e69-a7c4-1e231eb42d7c for instance a840063f-5498-40c6-a89b-053d1db08ef8 on hv-cinder-83608 May 10 21:20:35.702237 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-e23b119b-62fe-4a55-80e8-63b6879fe147 req-eeee0721-a86b-4b68-a719-622e1f66849b service nova] Acquired lock "compute-rpcapi-router" {{(pid=117679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 10 21:20:35.703920 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-39ddb142-7e1b-4e9c-a8b8-9fe719d62a6f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:35.704648 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-39ddb142-7e1b-4e9c-a8b8-9fe719d62a6f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:35.710988 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-39ddb142-7e1b-4e9c-a8b8-9fe719d62a6f None None] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:35.710988 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-39ddb142-7e1b-4e9c-a8b8-9fe719d62a6f None None] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:35.722542 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.compute.rpcapi [None req-39ddb142-7e1b-4e9c-a8b8-9fe719d62a6f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 10 21:20:35.726851 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-39ddb142-7e1b-4e9c-a8b8-9fe719d62a6f None None] Releasing lock "compute-rpcapi-router" {{(pid=117679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 10 21:20:35.774484 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-39ddb142-7e1b-4e9c-a8b8-9fe719d62a6f None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.264753 May 10 21:20:35.774484 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 16/44] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:20:36.523878 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-c936c277-ac82-461c-8016-676649858d12 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:36.524588 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-c936c277-ac82-461c-8016-676649858d12 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] [instance: a840063f-5498-40c6-a89b-053d1db08ef8] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:36.563031 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c936c277-ac82-461c-8016-676649858d12 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:36.563782 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c936c277-ac82-461c-8016-676649858d12 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:36.564799 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c936c277-ac82-461c-8016-676649858d12 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:36.565393 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c936c277-ac82-461c-8016-676649858d12 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:37.447360 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-c936c277-ac82-461c-8016-676649858d12 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250d6a26720a4416b62f5f7b2c646c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e738363e9f184b01a86d3459779cdfb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:37.459232 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-c936c277-ac82-461c-8016-676649858d12 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] 10.222.0.25 "GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8" status: 200 len: 1315 microversion: 2.1 time: 0.939545 May 10 21:20:37.461732 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 17/45] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:36 2022] GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8 => generated 1315 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:37.473387 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-89347f3f-a860-4cb1-86de-57c8e9e4fd7c tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-552112079", "imageRef": "2d72b3e0-7d02-481e-b5e6-17f44e8729d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c8e51741-489e-4b09-8a94-3245895caad6"}], "security_groups": [{"name": "tempest-securitygroup--341255279"}], "key_name": "tempest-keypair-141967161", "user_data": "}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:20:37.681651 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-417775aa-cdca-49c9-bef3-0c18cc34cf98 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Flavor limits 0:0:0 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 21:20:37.682345 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-417775aa-cdca-49c9-bef3-0c18cc34cf98 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Image limits 0:0:0 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 21:20:37.682820 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-417775aa-cdca-49c9-bef3-0c18cc34cf98 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Flavor pref 0:0:0 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 21:20:37.683400 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-417775aa-cdca-49c9-bef3-0c18cc34cf98 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Image pref 0:0:0 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 21:20:37.683948 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-417775aa-cdca-49c9-bef3-0c18cc34cf98 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 21:20:37.697765 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-417775aa-cdca-49c9-bef3-0c18cc34cf98 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:37.701059 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-417775aa-cdca-49c9-bef3-0c18cc34cf98 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:37.702103 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-417775aa-cdca-49c9-bef3-0c18cc34cf98 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:37.705622 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-417775aa-cdca-49c9-bef3-0c18cc34cf98 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:37.755510 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.quota [None req-417775aa-cdca-49c9-bef3-0c18cc34cf98 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Getting quotas for project 78072ca90bf6402b83863597c266a178. Resources: {'cores', 'instances', 'ram'} {{(pid=117678) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:20:37.760338 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.quota [None req-417775aa-cdca-49c9-bef3-0c18cc34cf98 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Getting quotas for user 02af0eded57547f489be63cd6dc09399 and project 78072ca90bf6402b83863597c266a178. Resources: {'cores', 'instances', 'ram'} {{(pid=117678) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:20:37.774305 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-417775aa-cdca-49c9-bef3-0c18cc34cf98 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Going to run 1 instances... {{(pid=117678) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 21:20:37.777651 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-417775aa-cdca-49c9-bef3-0c18cc34cf98 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d72b3e0-7d02-481e-b5e6-17f44e8729d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 21:20:37.860828 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.network.neutron [None req-89347f3f-a860-4cb1-86de-57c8e9e4fd7c tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] validate_networks() for [('c8e51741-489e-4b09-8a94-3245895caad6', None, None, None, None, None)] {{(pid=117679) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 21:20:37.942280 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-417775aa-cdca-49c9-bef3-0c18cc34cf98 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.655025 May 10 21:20:37.944235 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 29/46] 10.222.0.25 () {60 vars in 1146 bytes} [Tue May 10 21:20:34 2022] POST /compute/v2.1/servers => generated 383 bytes in 3658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 21:20:37.956388 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-1e8c515a-cc17-43b3-add9-c5b580fe383c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:37.957531 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-1e8c515a-cc17-43b3-add9-c5b580fe383c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:38.046265 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-1e8c515a-cc17-43b3-add9-c5b580fe383c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:38.057252 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-1e8c515a-cc17-43b3-add9-c5b580fe383c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1221 microversion: 2.1 time: 0.106913 May 10 21:20:38.064980 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 30/47] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:37 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1221 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:20:38.478214 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-be51f422-7d96-4234-a57f-f4db7409f91b tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:38.478919 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-be51f422-7d96-4234-a57f-f4db7409f91b tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] [instance: a840063f-5498-40c6-a89b-053d1db08ef8] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:38.491572 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-be51f422-7d96-4234-a57f-f4db7409f91b tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:38.493988 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-be51f422-7d96-4234-a57f-f4db7409f91b tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:38.495955 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-be51f422-7d96-4234-a57f-f4db7409f91b tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:38.496397 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-be51f422-7d96-4234-a57f-f4db7409f91b tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:38.733953 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-be51f422-7d96-4234-a57f-f4db7409f91b tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250d6a26720a4416b62f5f7b2c646c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e738363e9f184b01a86d3459779cdfb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:38.744296 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-be51f422-7d96-4234-a57f-f4db7409f91b tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] 10.222.0.25 "GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8" status: 200 len: 1315 microversion: 2.1 time: 0.270993 May 10 21:20:38.748460 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 31/48] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:38 2022] GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8 => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:20:38.957095 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-89347f3f-a860-4cb1-86de-57c8e9e4fd7c tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Flavor limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 21:20:38.957550 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-89347f3f-a860-4cb1-86de-57c8e9e4fd7c tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Image limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 21:20:38.957976 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-89347f3f-a860-4cb1-86de-57c8e9e4fd7c tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Flavor pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 21:20:38.959330 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-89347f3f-a860-4cb1-86de-57c8e9e4fd7c tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Image pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 21:20:38.960050 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-89347f3f-a860-4cb1-86de-57c8e9e4fd7c tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 21:20:38.969852 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-89347f3f-a860-4cb1-86de-57c8e9e4fd7c tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:38.970370 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-89347f3f-a860-4cb1-86de-57c8e9e4fd7c tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:38.971206 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-89347f3f-a860-4cb1-86de-57c8e9e4fd7c tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:38.971643 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-89347f3f-a860-4cb1-86de-57c8e9e4fd7c tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:39.000842 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-89347f3f-a860-4cb1-86de-57c8e9e4fd7c tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Getting quotas for project 604bb43d90e344d3a89838c6575d12c2. Resources: {'cores', 'instances', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:20:39.006797 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-89347f3f-a860-4cb1-86de-57c8e9e4fd7c tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Getting quotas for user 05eb9dfc751a4b44a8d4d7a03138f0d4 and project 604bb43d90e344d3a89838c6575d12c2. Resources: {'cores', 'instances', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:20:39.019476 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-89347f3f-a860-4cb1-86de-57c8e9e4fd7c tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Going to run 1 instances... {{(pid=117679) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 21:20:39.023490 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-89347f3f-a860-4cb1-86de-57c8e9e4fd7c tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d72b3e0-7d02-481e-b5e6-17f44e8729d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 21:20:39.076855 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-2a970df2-91d4-482c-aa92-890266eac74e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:39.077846 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-2a970df2-91d4-482c-aa92-890266eac74e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:39.084429 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2a970df2-91d4-482c-aa92-890266eac74e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:39.085159 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2a970df2-91d4-482c-aa92-890266eac74e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:39.086075 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2a970df2-91d4-482c-aa92-890266eac74e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:39.086813 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2a970df2-91d4-482c-aa92-890266eac74e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:39.134668 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-89347f3f-a860-4cb1-86de-57c8e9e4fd7c tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.671445 May 10 21:20:39.141069 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 18/49] 10.222.0.25 () {60 vars in 1146 bytes} [Tue May 10 21:20:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 1678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 21:20:39.147385 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-d5adfa25-aa45-4cd5-8bb3-6c147d2c8cd5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:39.148307 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-d5adfa25-aa45-4cd5-8bb3-6c147d2c8cd5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:39.189570 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-2a970df2-91d4-482c-aa92-890266eac74e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:39.199420 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-2a970df2-91d4-482c-aa92-890266eac74e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1225 microversion: 2.1 time: 0.127226 May 10 21:20:39.202726 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 32/50] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:39 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1225 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:20:39.434583 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-d5adfa25-aa45-4cd5-8bb3-6c147d2c8cd5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:39.451776 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-d5adfa25-aa45-4cd5-8bb3-6c147d2c8cd5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1236 microversion: 2.1 time: 0.309442 May 10 21:20:39.452791 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 19/51] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:39 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1236 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:39.764049 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-b3798011-80cb-4518-bf87-0c5e752f1ff7 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:39.764666 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-b3798011-80cb-4518-bf87-0c5e752f1ff7 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] [instance: a840063f-5498-40c6-a89b-053d1db08ef8] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:39.773978 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b3798011-80cb-4518-bf87-0c5e752f1ff7 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:39.774451 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b3798011-80cb-4518-bf87-0c5e752f1ff7 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:39.775232 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b3798011-80cb-4518-bf87-0c5e752f1ff7 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:39.775695 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b3798011-80cb-4518-bf87-0c5e752f1ff7 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:39.786882 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-1f59e772-c136-487b-9698-18db2a0beda1 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1170641050", "imageRef": "2d72b3e0-7d02-481e-b5e6-17f44e8729d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3f280d19-4e21-4706-a61f-7c29f950ac00"}], "security_groups": [{"name": "tempest-securitygroup--866324005"}], "key_name": "tempest-keypair-565096298", "user_data": "}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:20:40.077582 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.network.neutron [None req-1f59e772-c136-487b-9698-18db2a0beda1 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] validate_networks() for [('3f280d19-4e21-4706-a61f-7c29f950ac00', None, None, None, None, None)] {{(pid=117679) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 21:20:40.392465 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-b3798011-80cb-4518-bf87-0c5e752f1ff7 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250d6a26720a4416b62f5f7b2c646c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e738363e9f184b01a86d3459779cdfb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:40.401441 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-b3798011-80cb-4518-bf87-0c5e752f1ff7 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] 10.222.0.25 "GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8" status: 200 len: 1315 microversion: 2.1 time: 0.641454 May 10 21:20:40.402890 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 33/52] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:39 2022] GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8 => generated 1315 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:40.426645 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-33127353-c27f-4acb-ada6-c0e6d6a28704 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:40.428607 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-33127353-c27f-4acb-ada6-c0e6d6a28704 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:40.448724 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-33127353-c27f-4acb-ada6-c0e6d6a28704 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:40.451635 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-33127353-c27f-4acb-ada6-c0e6d6a28704 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:40.460607 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-33127353-c27f-4acb-ada6-c0e6d6a28704 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:40.473521 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-33127353-c27f-4acb-ada6-c0e6d6a28704 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:40.600236 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-33127353-c27f-4acb-ada6-c0e6d6a28704 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:40.619540 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-33127353-c27f-4acb-ada6-c0e6d6a28704 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1217 microversion: 2.1 time: 0.213809 May 10 21:20:40.622715 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 34/53] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:40 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1217 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:40.664158 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-0827ee55-0c59-4297-965c-deeb42a0523b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1410053112", "imageRef": "2d72b3e0-7d02-481e-b5e6-17f44e8729d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "169df5df-f41d-4a2b-9d9a-2bdd14f9c862"}], "security_groups": [{"name": "tempest-securitygroup--1742983188"}], "key_name": "tempest-keypair-163365215", "user_data": "}} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:20:41.573807 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-1f59e772-c136-487b-9698-18db2a0beda1 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Flavor limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 21:20:41.573807 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-1f59e772-c136-487b-9698-18db2a0beda1 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Image limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 21:20:41.574921 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-1f59e772-c136-487b-9698-18db2a0beda1 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Flavor pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 21:20:41.574921 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-1f59e772-c136-487b-9698-18db2a0beda1 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Image pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 21:20:41.575184 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-1f59e772-c136-487b-9698-18db2a0beda1 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 21:20:41.586678 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1f59e772-c136-487b-9698-18db2a0beda1 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:41.587804 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1f59e772-c136-487b-9698-18db2a0beda1 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:41.589047 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1f59e772-c136-487b-9698-18db2a0beda1 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:41.589688 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1f59e772-c136-487b-9698-18db2a0beda1 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:41.612549 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-1f59e772-c136-487b-9698-18db2a0beda1 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Getting quotas for project 8286226c580f4896aec72c65642fce30. Resources: {'cores', 'instances', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:20:41.629610 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-1f59e772-c136-487b-9698-18db2a0beda1 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Getting quotas for user ca39678abe6e476283f94c675d4ea369 and project 8286226c580f4896aec72c65642fce30. Resources: {'cores', 'instances', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:20:41.683758 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-1f59e772-c136-487b-9698-18db2a0beda1 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Going to run 1 instances... {{(pid=117679) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 21:20:41.689653 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-1f59e772-c136-487b-9698-18db2a0beda1 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d72b3e0-7d02-481e-b5e6-17f44e8729d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 21:20:41.886213 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.network.neutron [None req-0827ee55-0c59-4297-965c-deeb42a0523b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] validate_networks() for [('169df5df-f41d-4a2b-9d9a-2bdd14f9c862', None, None, None, None, None)] {{(pid=117678) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 21:20:42.624239 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-0827ee55-0c59-4297-965c-deeb42a0523b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Flavor limits 0:0:0 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 21:20:42.624239 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-0827ee55-0c59-4297-965c-deeb42a0523b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Image limits 0:0:0 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 21:20:42.624509 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-0827ee55-0c59-4297-965c-deeb42a0523b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Flavor pref 0:0:0 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 21:20:42.624905 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-0827ee55-0c59-4297-965c-deeb42a0523b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Image pref 0:0:0 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 21:20:42.625271 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-0827ee55-0c59-4297-965c-deeb42a0523b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 21:20:42.635240 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0827ee55-0c59-4297-965c-deeb42a0523b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:42.635639 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0827ee55-0c59-4297-965c-deeb42a0523b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:42.636860 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0827ee55-0c59-4297-965c-deeb42a0523b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:42.637451 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0827ee55-0c59-4297-965c-deeb42a0523b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:42.656815 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.quota [None req-0827ee55-0c59-4297-965c-deeb42a0523b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Getting quotas for project 802e2ef29f6f4b2c8ca69204b69cc142. Resources: {'cores', 'instances', 'ram'} {{(pid=117678) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:20:42.660955 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.quota [None req-0827ee55-0c59-4297-965c-deeb42a0523b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Getting quotas for user d2267b0c3311480eb8d1f54df5296c4c and project 802e2ef29f6f4b2c8ca69204b69cc142. Resources: {'cores', 'instances', 'ram'} {{(pid=117678) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:20:42.673645 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-0827ee55-0c59-4297-965c-deeb42a0523b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Going to run 1 instances... {{(pid=117678) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 21:20:42.675849 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-0827ee55-0c59-4297-965c-deeb42a0523b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d72b3e0-7d02-481e-b5e6-17f44e8729d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 21:20:42.916790 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-1f59e772-c136-487b-9698-18db2a0beda1 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.135020 May 10 21:20:42.922128 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 20/54] 10.222.0.25 () {60 vars in 1146 bytes} [Tue May 10 21:20:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 3137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 21:20:42.922747 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-d014c8de-bc97-4a7e-9d3d-0e4b50fccec4 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:42.923369 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-d014c8de-bc97-4a7e-9d3d-0e4b50fccec4 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:42.931341 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d014c8de-bc97-4a7e-9d3d-0e4b50fccec4 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:42.931808 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d014c8de-bc97-4a7e-9d3d-0e4b50fccec4 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:42.932596 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d014c8de-bc97-4a7e-9d3d-0e4b50fccec4 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:42.933490 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d014c8de-bc97-4a7e-9d3d-0e4b50fccec4 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:42.955217 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-0827ee55-0c59-4297-965c-deeb42a0523b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.307317 May 10 21:20:42.965687 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 35/55] 10.222.0.25 () {62 vars in 1187 bytes} [Tue May 10 21:20:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 2342 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 10 21:20:42.977454 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-0b03456b-4168-4e69-8e2c-11fc405e42ea tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:42.978074 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-0b03456b-4168-4e69-8e2c-11fc405e42ea tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] [instance: a840063f-5498-40c6-a89b-053d1db08ef8] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:43.002045 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0b03456b-4168-4e69-8e2c-11fc405e42ea tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:43.004908 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0b03456b-4168-4e69-8e2c-11fc405e42ea tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:43.008467 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0b03456b-4168-4e69-8e2c-11fc405e42ea tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:43.009128 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0b03456b-4168-4e69-8e2c-11fc405e42ea tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:43.134807 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-d014c8de-bc97-4a7e-9d3d-0e4b50fccec4 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:43.148685 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-d014c8de-bc97-4a7e-9d3d-0e4b50fccec4 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1288 microversion: 2.1 time: 0.229526 May 10 21:20:43.150578 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 21/56] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:42 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1288 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:43.167458 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-53f7bd01-c521-4eb2-921c-2411448c9c75 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:43.168430 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-53f7bd01-c521-4eb2-921c-2411448c9c75 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:43.183936 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-53f7bd01-c521-4eb2-921c-2411448c9c75 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:43.187262 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-53f7bd01-c521-4eb2-921c-2411448c9c75 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:43.193737 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-53f7bd01-c521-4eb2-921c-2411448c9c75 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:43.197041 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-53f7bd01-c521-4eb2-921c-2411448c9c75 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:43.300747 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-53f7bd01-c521-4eb2-921c-2411448c9c75 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:43.311340 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-53f7bd01-c521-4eb2-921c-2411448c9c75 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1281 microversion: 2.1 time: 0.155678 May 10 21:20:43.323216 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 22/57] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:43 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1281 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:43.323216 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-83d04d6d-3c66-4b97-9dbd-27119be19f71 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:43.323216 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-83d04d6d-3c66-4b97-9dbd-27119be19f71 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:43.378564 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-83d04d6d-3c66-4b97-9dbd-27119be19f71 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:43.386414 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-83d04d6d-3c66-4b97-9dbd-27119be19f71 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2" status: 200 len: 1241 microversion: 2.1 time: 0.073025 May 10 21:20:43.395675 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 23/58] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:43 2022] GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2 => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:43.402049 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-c02253de-79d7-4d45-9e64-eadef83d7c12 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:43.402947 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-c02253de-79d7-4d45-9e64-eadef83d7c12 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:43.487700 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-c02253de-79d7-4d45-9e64-eadef83d7c12 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:43.496486 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-c02253de-79d7-4d45-9e64-eadef83d7c12 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:43.498301 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-c02253de-79d7-4d45-9e64-eadef83d7c12 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:43.499605 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-c02253de-79d7-4d45-9e64-eadef83d7c12 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1281 microversion: 2.20 time: 0.102444 May 10 21:20:43.511286 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 24/59] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:20:43 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1281 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:20:43.668897 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-0b03456b-4168-4e69-8e2c-11fc405e42ea tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250d6a26720a4416b62f5f7b2c646c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e738363e9f184b01a86d3459779cdfb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:43.676304 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-0b03456b-4168-4e69-8e2c-11fc405e42ea tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] 10.222.0.25 "GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8" status: 200 len: 1315 microversion: 2.1 time: 0.709445 May 10 21:20:43.677910 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 36/60] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:42 2022] GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8 => generated 1315 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:44.167823 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-7aa320dc-e897-4aae-b3d3-0554c9901936 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:44.169035 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-7aa320dc-e897-4aae-b3d3-0554c9901936 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:44.175384 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7aa320dc-e897-4aae-b3d3-0554c9901936 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:44.175841 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7aa320dc-e897-4aae-b3d3-0554c9901936 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:44.176636 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7aa320dc-e897-4aae-b3d3-0554c9901936 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:44.177917 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7aa320dc-e897-4aae-b3d3-0554c9901936 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:44.265008 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-7aa320dc-e897-4aae-b3d3-0554c9901936 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:44.275322 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-7aa320dc-e897-4aae-b3d3-0554c9901936 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1288 microversion: 2.1 time: 0.110691 May 10 21:20:44.276549 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 25/61] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:44 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1288 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:44.331259 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-48d15658-620b-4e65-be06-937c07b19d25 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:44.332405 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-48d15658-620b-4e65-be06-937c07b19d25 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:44.338716 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-48d15658-620b-4e65-be06-937c07b19d25 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:44.339159 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-48d15658-620b-4e65-be06-937c07b19d25 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:44.339915 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-48d15658-620b-4e65-be06-937c07b19d25 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:44.340339 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-48d15658-620b-4e65-be06-937c07b19d25 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:44.406494 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-377c2181-e0c4-4710-8bfd-b041ac789f71 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:44.407125 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-377c2181-e0c4-4710-8bfd-b041ac789f71 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:44.409008 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-48d15658-620b-4e65-be06-937c07b19d25 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:44.414826 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-377c2181-e0c4-4710-8bfd-b041ac789f71 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:44.416145 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-377c2181-e0c4-4710-8bfd-b041ac789f71 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:44.416498 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-377c2181-e0c4-4710-8bfd-b041ac789f71 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:44.417066 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-377c2181-e0c4-4710-8bfd-b041ac789f71 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:44.417756 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-48d15658-620b-4e65-be06-937c07b19d25 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1281 microversion: 2.1 time: 0.090674 May 10 21:20:44.418475 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 37/62] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:44 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1281 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:44.482619 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-377c2181-e0c4-4710-8bfd-b041ac789f71 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:44.495571 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-377c2181-e0c4-4710-8bfd-b041ac789f71 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2" status: 200 len: 1245 microversion: 2.1 time: 0.093161 May 10 21:20:44.496190 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 26/63] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:44 2022] GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2 => generated 1245 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:20:44.518704 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-fd78a0d5-21c4-4692-a393-1144cb873cd9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:44.519377 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-fd78a0d5-21c4-4692-a393-1144cb873cd9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:44.526271 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-fd78a0d5-21c4-4692-a393-1144cb873cd9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:44.526764 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-fd78a0d5-21c4-4692-a393-1144cb873cd9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:44.527538 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-fd78a0d5-21c4-4692-a393-1144cb873cd9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:44.527970 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-fd78a0d5-21c4-4692-a393-1144cb873cd9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:44.601541 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-fd78a0d5-21c4-4692-a393-1144cb873cd9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:44.612882 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-fd78a0d5-21c4-4692-a393-1144cb873cd9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:44.615538 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-fd78a0d5-21c4-4692-a393-1144cb873cd9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:44.616761 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-fd78a0d5-21c4-4692-a393-1144cb873cd9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1285 microversion: 2.20 time: 0.102232 May 10 21:20:44.617937 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 38/64] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:20:44 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:20:44.693673 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-deafacba-6141-4e95-9106-703a02c1e6dd tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:44.694296 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-deafacba-6141-4e95-9106-703a02c1e6dd tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] [instance: a840063f-5498-40c6-a89b-053d1db08ef8] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:44.704398 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-deafacba-6141-4e95-9106-703a02c1e6dd tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:44.704398 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-deafacba-6141-4e95-9106-703a02c1e6dd tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:44.704398 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-deafacba-6141-4e95-9106-703a02c1e6dd tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:44.704398 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-deafacba-6141-4e95-9106-703a02c1e6dd tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:44.863006 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-deafacba-6141-4e95-9106-703a02c1e6dd tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250d6a26720a4416b62f5f7b2c646c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e738363e9f184b01a86d3459779cdfb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:44.870733 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-deafacba-6141-4e95-9106-703a02c1e6dd tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] 10.222.0.25 "GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8" status: 200 len: 1315 microversion: 2.1 time: 0.181405 May 10 21:20:44.871327 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 27/65] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:44 2022] GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:45.292853 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-74cd42c5-7f49-4620-ae0a-f3a887ed9c56 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:45.293472 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-74cd42c5-7f49-4620-ae0a-f3a887ed9c56 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:45.299277 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-74cd42c5-7f49-4620-ae0a-f3a887ed9c56 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:45.299725 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-74cd42c5-7f49-4620-ae0a-f3a887ed9c56 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:45.300492 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-74cd42c5-7f49-4620-ae0a-f3a887ed9c56 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:45.300926 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-74cd42c5-7f49-4620-ae0a-f3a887ed9c56 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:45.361353 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-74cd42c5-7f49-4620-ae0a-f3a887ed9c56 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:45.369430 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-74cd42c5-7f49-4620-ae0a-f3a887ed9c56 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1288 microversion: 2.1 time: 0.081114 May 10 21:20:45.370023 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 39/66] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:45 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1288 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:20:45.434521 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-8ac37df7-a3e5-41bb-a74b-bdba82502eaf tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:45.435120 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-8ac37df7-a3e5-41bb-a74b-bdba82502eaf tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:45.441270 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8ac37df7-a3e5-41bb-a74b-bdba82502eaf tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:45.441842 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8ac37df7-a3e5-41bb-a74b-bdba82502eaf tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:45.442806 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8ac37df7-a3e5-41bb-a74b-bdba82502eaf tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:45.443239 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8ac37df7-a3e5-41bb-a74b-bdba82502eaf tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:45.513667 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-f45e4484-f2d9-4447-af98-7cdbd848eb76 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:45.514285 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-f45e4484-f2d9-4447-af98-7cdbd848eb76 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:45.521211 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f45e4484-f2d9-4447-af98-7cdbd848eb76 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:45.522114 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f45e4484-f2d9-4447-af98-7cdbd848eb76 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:45.522955 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f45e4484-f2d9-4447-af98-7cdbd848eb76 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:45.523544 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f45e4484-f2d9-4447-af98-7cdbd848eb76 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:45.525275 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8ac37df7-a3e5-41bb-a74b-bdba82502eaf tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:45.537572 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-8ac37df7-a3e5-41bb-a74b-bdba82502eaf tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1281 microversion: 2.1 time: 0.106683 May 10 21:20:45.538459 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 28/67] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:45 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1281 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:45.590011 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-f45e4484-f2d9-4447-af98-7cdbd848eb76 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:45.597296 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-f45e4484-f2d9-4447-af98-7cdbd848eb76 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2" status: 200 len: 1245 microversion: 2.1 time: 0.088505 May 10 21:20:45.597869 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 40/68] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:45 2022] GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2 => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:20:45.635104 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-7290f3fb-8af2-4233-82e6-f9599ffac9c3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:45.636012 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-7290f3fb-8af2-4233-82e6-f9599ffac9c3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:45.642085 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7290f3fb-8af2-4233-82e6-f9599ffac9c3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:45.642570 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7290f3fb-8af2-4233-82e6-f9599ffac9c3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:45.643334 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7290f3fb-8af2-4233-82e6-f9599ffac9c3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:45.643766 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7290f3fb-8af2-4233-82e6-f9599ffac9c3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:45.708067 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-7290f3fb-8af2-4233-82e6-f9599ffac9c3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:45.715284 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-7290f3fb-8af2-4233-82e6-f9599ffac9c3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:45.716780 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-7290f3fb-8af2-4233-82e6-f9599ffac9c3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:45.717874 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-7290f3fb-8af2-4233-82e6-f9599ffac9c3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1285 microversion: 2.20 time: 0.086673 May 10 21:20:45.718448 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 29/69] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:20:45 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:20:45.888844 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-892a181d-cd70-4c71-a20b-775b2041ae01 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:45.888844 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-892a181d-cd70-4c71-a20b-775b2041ae01 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] [instance: a840063f-5498-40c6-a89b-053d1db08ef8] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:45.893976 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-892a181d-cd70-4c71-a20b-775b2041ae01 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:45.894425 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-892a181d-cd70-4c71-a20b-775b2041ae01 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:45.895208 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-892a181d-cd70-4c71-a20b-775b2041ae01 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:45.896138 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-892a181d-cd70-4c71-a20b-775b2041ae01 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:46.031081 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-892a181d-cd70-4c71-a20b-775b2041ae01 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250d6a26720a4416b62f5f7b2c646c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e738363e9f184b01a86d3459779cdfb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:46.039384 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-892a181d-cd70-4c71-a20b-775b2041ae01 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] 10.222.0.25 "GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8" status: 200 len: 1315 microversion: 2.1 time: 0.155859 May 10 21:20:46.039965 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 41/70] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:45 2022] GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:46.390669 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-9351c6e5-dac8-4cd3-bb30-2af4eca60f22 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:46.390669 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-9351c6e5-dac8-4cd3-bb30-2af4eca60f22 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:46.394217 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9351c6e5-dac8-4cd3-bb30-2af4eca60f22 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:46.394690 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9351c6e5-dac8-4cd3-bb30-2af4eca60f22 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:46.395557 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9351c6e5-dac8-4cd3-bb30-2af4eca60f22 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:46.396719 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9351c6e5-dac8-4cd3-bb30-2af4eca60f22 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:46.460625 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-9351c6e5-dac8-4cd3-bb30-2af4eca60f22 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:46.469282 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-9351c6e5-dac8-4cd3-bb30-2af4eca60f22 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1288 microversion: 2.1 time: 0.086370 May 10 21:20:46.469866 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 30/71] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:46 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1288 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:46.555100 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-d1f87a15-9946-4a9b-a8d6-4b7d601b00a8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:46.555990 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-d1f87a15-9946-4a9b-a8d6-4b7d601b00a8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:46.561721 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d1f87a15-9946-4a9b-a8d6-4b7d601b00a8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:46.562171 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d1f87a15-9946-4a9b-a8d6-4b7d601b00a8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:46.562972 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d1f87a15-9946-4a9b-a8d6-4b7d601b00a8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:46.563417 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d1f87a15-9946-4a9b-a8d6-4b7d601b00a8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:46.614738 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-78d0bc83-54ac-46d0-aa4b-839d75529913 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:46.620068 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-78d0bc83-54ac-46d0-aa4b-839d75529913 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:46.621452 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-78d0bc83-54ac-46d0-aa4b-839d75529913 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:46.621899 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-78d0bc83-54ac-46d0-aa4b-839d75529913 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:46.622691 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-78d0bc83-54ac-46d0-aa4b-839d75529913 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:46.623125 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-78d0bc83-54ac-46d0-aa4b-839d75529913 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:46.630620 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-d1f87a15-9946-4a9b-a8d6-4b7d601b00a8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:46.646677 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-d1f87a15-9946-4a9b-a8d6-4b7d601b00a8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1281 microversion: 2.1 time: 0.092269 May 10 21:20:46.646677 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 42/72] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:46 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1281 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:46.684833 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-78d0bc83-54ac-46d0-aa4b-839d75529913 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:46.692131 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-78d0bc83-54ac-46d0-aa4b-839d75529913 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2" status: 200 len: 1245 microversion: 2.1 time: 0.082062 May 10 21:20:46.693491 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 31/73] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:46 2022] GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:46.739054 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-52b78117-bb8a-41fc-bb62-260e4ed80b64 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:46.740811 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-52b78117-bb8a-41fc-bb62-260e4ed80b64 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:46.747271 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-52b78117-bb8a-41fc-bb62-260e4ed80b64 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:46.747845 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-52b78117-bb8a-41fc-bb62-260e4ed80b64 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:46.748715 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-52b78117-bb8a-41fc-bb62-260e4ed80b64 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:46.749295 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-52b78117-bb8a-41fc-bb62-260e4ed80b64 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:46.813204 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-52b78117-bb8a-41fc-bb62-260e4ed80b64 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:46.838613 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-52b78117-bb8a-41fc-bb62-260e4ed80b64 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:46.840951 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-52b78117-bb8a-41fc-bb62-260e4ed80b64 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:46.842254 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-52b78117-bb8a-41fc-bb62-260e4ed80b64 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1285 microversion: 2.20 time: 0.108179 May 10 21:20:46.856436 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 43/74] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:20:46 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1285 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:20:47.058096 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-2f0d5eba-597b-4bc8-b617-fe9143a57e07 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:47.059147 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-2f0d5eba-597b-4bc8-b617-fe9143a57e07 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] [instance: a840063f-5498-40c6-a89b-053d1db08ef8] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:47.067788 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2f0d5eba-597b-4bc8-b617-fe9143a57e07 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:47.071550 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2f0d5eba-597b-4bc8-b617-fe9143a57e07 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:47.072743 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2f0d5eba-597b-4bc8-b617-fe9143a57e07 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:47.075523 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2f0d5eba-597b-4bc8-b617-fe9143a57e07 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:47.316454 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2f0d5eba-597b-4bc8-b617-fe9143a57e07 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250d6a26720a4416b62f5f7b2c646c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e738363e9f184b01a86d3459779cdfb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:47.325411 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-2f0d5eba-597b-4bc8-b617-fe9143a57e07 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] 10.222.0.25 "GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8" status: 200 len: 1315 microversion: 2.1 time: 0.271703 May 10 21:20:47.326001 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 32/75] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:47 2022] GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8 => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:47.487230 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-ea3e4bce-8d1e-4294-9e64-700b83712216 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:47.488705 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-ea3e4bce-8d1e-4294-9e64-700b83712216 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:47.501853 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ea3e4bce-8d1e-4294-9e64-700b83712216 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:47.511271 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ea3e4bce-8d1e-4294-9e64-700b83712216 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:47.511271 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ea3e4bce-8d1e-4294-9e64-700b83712216 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:47.511271 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ea3e4bce-8d1e-4294-9e64-700b83712216 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:47.632368 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-ea3e4bce-8d1e-4294-9e64-700b83712216 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:47.653828 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-ea3e4bce-8d1e-4294-9e64-700b83712216 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1296 microversion: 2.1 time: 0.170201 May 10 21:20:47.655052 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 44/76] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:47 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1296 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:47.660723 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-cad50932-ebb1-4f80-8ad0-2db1f54da2b6 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:47.662687 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-cad50932-ebb1-4f80-8ad0-2db1f54da2b6 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:47.671613 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cad50932-ebb1-4f80-8ad0-2db1f54da2b6 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:47.674574 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cad50932-ebb1-4f80-8ad0-2db1f54da2b6 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:47.676746 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cad50932-ebb1-4f80-8ad0-2db1f54da2b6 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:47.678575 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cad50932-ebb1-4f80-8ad0-2db1f54da2b6 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:47.711625 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-fa8a4942-572c-4bd6-b1e7-46a2a62cc1dd tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:47.712477 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-fa8a4942-572c-4bd6-b1e7-46a2a62cc1dd tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:47.727474 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-fa8a4942-572c-4bd6-b1e7-46a2a62cc1dd tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:47.730706 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-fa8a4942-572c-4bd6-b1e7-46a2a62cc1dd tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:47.733183 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-fa8a4942-572c-4bd6-b1e7-46a2a62cc1dd tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:47.735923 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-fa8a4942-572c-4bd6-b1e7-46a2a62cc1dd tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:47.891450 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-cad50932-ebb1-4f80-8ad0-2db1f54da2b6 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:47.902802 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-cad50932-ebb1-4f80-8ad0-2db1f54da2b6 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1279 microversion: 2.1 time: 0.243424 May 10 21:20:47.907669 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 33/77] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:47 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1279 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:47.944889 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-c1b62917-59b6-4dae-b4e7-e95424f82258 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:47.948321 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-c1b62917-59b6-4dae-b4e7-e95424f82258 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:47.964989 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c1b62917-59b6-4dae-b4e7-e95424f82258 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:47.964989 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c1b62917-59b6-4dae-b4e7-e95424f82258 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:47.965771 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c1b62917-59b6-4dae-b4e7-e95424f82258 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:47.967532 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c1b62917-59b6-4dae-b4e7-e95424f82258 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:48.062615 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-fa8a4942-572c-4bd6-b1e7-46a2a62cc1dd tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:48.083649 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-fa8a4942-572c-4bd6-b1e7-46a2a62cc1dd tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2" status: 200 len: 1293 microversion: 2.1 time: 0.376856 May 10 21:20:48.084323 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 45/78] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:47 2022] GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2 => generated 1293 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:48.100296 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-c1b62917-59b6-4dae-b4e7-e95424f82258 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:48.110745 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-c1b62917-59b6-4dae-b4e7-e95424f82258 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:48.112930 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-c1b62917-59b6-4dae-b4e7-e95424f82258 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:48.116584 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-c1b62917-59b6-4dae-b4e7-e95424f82258 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1333 microversion: 2.20 time: 0.207710 May 10 21:20:48.128424 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 34/79] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:20:47 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1333 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:20:48.171099 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-3652677a-eb46-4d31-8690-7aaadfb56e71 req-e303253c-d119-430a-98e1-7d3f17a01cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4ec9c2a-8806-4da8-9072-ca136cfa83ad", "tag": "5408ed5b-410e-4f80-8588-0d5ecd304dea"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:20:48.215358 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-3652677a-eb46-4d31-8690-7aaadfb56e71 req-e303253c-d119-430a-98e1-7d3f17a01cc7 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:48.221326 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-3652677a-eb46-4d31-8690-7aaadfb56e71 req-e303253c-d119-430a-98e1-7d3f17a01cc7 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:48.280710 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-3652677a-eb46-4d31-8690-7aaadfb56e71 req-e303253c-d119-430a-98e1-7d3f17a01cc7 service nova] Creating event network-changed:5408ed5b-410e-4f80-8588-0d5ecd304dea for instance e4ec9c2a-8806-4da8-9072-ca136cfa83ad on hv-cinder-83608 May 10 21:20:48.281256 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-3652677a-eb46-4d31-8690-7aaadfb56e71 req-e303253c-d119-430a-98e1-7d3f17a01cc7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117678) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 10 21:20:48.284167 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4a8b9dad-8897-4779-937a-0d5a669c0cea None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:48.284610 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4a8b9dad-8897-4779-937a-0d5a669c0cea None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:48.285403 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4a8b9dad-8897-4779-937a-0d5a669c0cea None None] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:48.285825 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4a8b9dad-8897-4779-937a-0d5a669c0cea None None] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:48.326670 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.compute.rpcapi [None req-4a8b9dad-8897-4779-937a-0d5a669c0cea None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 10 21:20:48.327703 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4a8b9dad-8897-4779-937a-0d5a669c0cea None None] Releasing lock "compute-rpcapi-router" {{(pid=117678) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 10 21:20:48.346777 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-37d7abeb-662a-406c-ab90-811147be7b80 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:48.349366 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-37d7abeb-662a-406c-ab90-811147be7b80 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] [instance: a840063f-5498-40c6-a89b-053d1db08ef8] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:48.360871 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-37d7abeb-662a-406c-ab90-811147be7b80 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:48.361382 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-37d7abeb-662a-406c-ab90-811147be7b80 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:48.362196 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-37d7abeb-662a-406c-ab90-811147be7b80 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:48.362673 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-37d7abeb-662a-406c-ab90-811147be7b80 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:48.372400 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-4a8b9dad-8897-4779-937a-0d5a669c0cea None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.204729 May 10 21:20:48.373032 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 46/80] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:20:48.673508 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-f30f94eb-0e6e-47a7-9631-84f1d577d2f2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:48.674317 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-f30f94eb-0e6e-47a7-9631-84f1d577d2f2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:48.688954 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f30f94eb-0e6e-47a7-9631-84f1d577d2f2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:48.689409 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f30f94eb-0e6e-47a7-9631-84f1d577d2f2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:48.690199 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f30f94eb-0e6e-47a7-9631-84f1d577d2f2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:48.690674 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f30f94eb-0e6e-47a7-9631-84f1d577d2f2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:48.875672 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-f30f94eb-0e6e-47a7-9631-84f1d577d2f2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:48.890455 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-f30f94eb-0e6e-47a7-9631-84f1d577d2f2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1294 microversion: 2.1 time: 0.221408 May 10 21:20:48.891710 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 47/81] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:48 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1294 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:48.897559 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-37d7abeb-662a-406c-ab90-811147be7b80 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250d6a26720a4416b62f5f7b2c646c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e738363e9f184b01a86d3459779cdfb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:48.913554 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-37d7abeb-662a-406c-ab90-811147be7b80 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] 10.222.0.25 "GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8" status: 200 len: 1315 microversion: 2.1 time: 0.573592 May 10 21:20:48.914495 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 35/82] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:48 2022] GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8 => generated 1315 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:48.928389 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-3c94a981-515b-4152-a21e-7f6760fea7df tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:48.929580 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-3c94a981-515b-4152-a21e-7f6760fea7df tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:48.936244 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3c94a981-515b-4152-a21e-7f6760fea7df tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:48.936924 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3c94a981-515b-4152-a21e-7f6760fea7df tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:48.937897 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3c94a981-515b-4152-a21e-7f6760fea7df tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:48.938564 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3c94a981-515b-4152-a21e-7f6760fea7df tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:49.107023 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6681610f-80f8-40ae-a09a-e481e98ae860 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:49.107640 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-6681610f-80f8-40ae-a09a-e481e98ae860 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:49.128573 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6681610f-80f8-40ae-a09a-e481e98ae860 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:49.128573 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6681610f-80f8-40ae-a09a-e481e98ae860 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:49.132424 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6681610f-80f8-40ae-a09a-e481e98ae860 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:49.133414 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6681610f-80f8-40ae-a09a-e481e98ae860 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:49.375328 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-6681610f-80f8-40ae-a09a-e481e98ae860 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:49.392313 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-6681610f-80f8-40ae-a09a-e481e98ae860 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2" status: 200 len: 1311 microversion: 2.1 time: 0.289176 May 10 21:20:49.409227 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-3c94a981-515b-4152-a21e-7f6760fea7df tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:49.420512 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 36/83] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:49 2022] GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2 => generated 1311 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:20:49.425731 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-3c94a981-515b-4152-a21e-7f6760fea7df tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1321 microversion: 2.1 time: 0.501547 May 10 21:20:49.426392 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 48/84] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:48 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1321 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:49.435709 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-1f49f955-74f9-445f-b99f-405a95e6034f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:49.436387 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-1f49f955-74f9-445f-b99f-405a95e6034f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:49.457587 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1f49f955-74f9-445f-b99f-405a95e6034f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:49.458175 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1f49f955-74f9-445f-b99f-405a95e6034f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:49.459184 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1f49f955-74f9-445f-b99f-405a95e6034f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:49.459620 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1f49f955-74f9-445f-b99f-405a95e6034f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:49.908109 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-32e62dd6-1594-4185-956c-3978e3011d93 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:49.909241 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-32e62dd6-1594-4185-956c-3978e3011d93 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:49.920558 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-32e62dd6-1594-4185-956c-3978e3011d93 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:49.926465 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-32e62dd6-1594-4185-956c-3978e3011d93 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:49.926465 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-32e62dd6-1594-4185-956c-3978e3011d93 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:49.926465 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-32e62dd6-1594-4185-956c-3978e3011d93 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:50.033779 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1f49f955-74f9-445f-b99f-405a95e6034f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:50.046003 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1f49f955-74f9-445f-b99f-405a95e6034f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:50.051769 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1f49f955-74f9-445f-b99f-405a95e6034f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:50.055300 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-1f49f955-74f9-445f-b99f-405a95e6034f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1339 microversion: 2.20 time: 0.633522 May 10 21:20:50.056089 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 37/85] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:20:49 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1339 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:20:50.066368 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-b53afa26-e13a-47a8-be35-84fc13ff2ab3 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:50.067553 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-b53afa26-e13a-47a8-be35-84fc13ff2ab3 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] [instance: a840063f-5498-40c6-a89b-053d1db08ef8] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:50.085445 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b53afa26-e13a-47a8-be35-84fc13ff2ab3 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:50.086095 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b53afa26-e13a-47a8-be35-84fc13ff2ab3 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:50.087310 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b53afa26-e13a-47a8-be35-84fc13ff2ab3 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:50.087866 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b53afa26-e13a-47a8-be35-84fc13ff2ab3 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:50.104333 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-32e62dd6-1594-4185-956c-3978e3011d93 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:50.117599 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-32e62dd6-1594-4185-956c-3978e3011d93 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1294 microversion: 2.1 time: 0.213408 May 10 21:20:50.124080 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 49/86] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:49 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1294 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:50.216268 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-e56ca974-caf3-46b8-89a4-8f2fc4d418ed req-2e260049-352c-4a56-a120-96c8f10c28a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a840063f-5498-40c6-a89b-053d1db08ef8", "name": "network-vif-plugged", "status": "completed", "tag": "7cc3e14f-fcea-4e69-a7c4-1e231eb42d7c"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:20:50.223145 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-e56ca974-caf3-46b8-89a4-8f2fc4d418ed req-2e260049-352c-4a56-a120-96c8f10c28a0 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:50.224171 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-e56ca974-caf3-46b8-89a4-8f2fc4d418ed req-2e260049-352c-4a56-a120-96c8f10c28a0 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:50.235200 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-e56ca974-caf3-46b8-89a4-8f2fc4d418ed req-2e260049-352c-4a56-a120-96c8f10c28a0 service nova] Creating event network-vif-plugged:7cc3e14f-fcea-4e69-a7c4-1e231eb42d7c for instance a840063f-5498-40c6-a89b-053d1db08ef8 on hv-cinder-83608 May 10 21:20:50.240777 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-e56ca974-caf3-46b8-89a4-8f2fc4d418ed req-2e260049-352c-4a56-a120-96c8f10c28a0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114957 May 10 21:20:50.241378 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 50/87] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:20:50.359838 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b53afa26-e13a-47a8-be35-84fc13ff2ab3 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250d6a26720a4416b62f5f7b2c646c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e738363e9f184b01a86d3459779cdfb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:50.369796 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-b53afa26-e13a-47a8-be35-84fc13ff2ab3 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] 10.222.0.25 "GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8" status: 200 len: 1315 microversion: 2.1 time: 0.309071 May 10 21:20:50.395872 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 38/88] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:50 2022] GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8 => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:50.410317 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-f0c3a778-7279-455f-9f1a-950280f5b6c8 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:50.411703 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-f0c3a778-7279-455f-9f1a-950280f5b6c8 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:50.418676 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f0c3a778-7279-455f-9f1a-950280f5b6c8 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:50.419121 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f0c3a778-7279-455f-9f1a-950280f5b6c8 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:50.419893 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f0c3a778-7279-455f-9f1a-950280f5b6c8 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:50.420325 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f0c3a778-7279-455f-9f1a-950280f5b6c8 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:50.453267 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-9044ae44-01ca-4ca4-b2b1-4242c5c625f3 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:50.456580 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-9044ae44-01ca-4ca4-b2b1-4242c5c625f3 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:50.471238 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9044ae44-01ca-4ca4-b2b1-4242c5c625f3 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:50.477970 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9044ae44-01ca-4ca4-b2b1-4242c5c625f3 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:50.478892 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9044ae44-01ca-4ca4-b2b1-4242c5c625f3 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:50.480840 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9044ae44-01ca-4ca4-b2b1-4242c5c625f3 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:50.616248 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-f0c3a778-7279-455f-9f1a-950280f5b6c8 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:50.626054 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-f0c3a778-7279-455f-9f1a-950280f5b6c8 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2" status: 200 len: 1299 microversion: 2.1 time: 0.219620 May 10 21:20:50.626541 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 51/89] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:50 2022] GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2 => generated 1299 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:50.959841 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-9044ae44-01ca-4ca4-b2b1-4242c5c625f3 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:50.975638 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-9044ae44-01ca-4ca4-b2b1-4242c5c625f3 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1321 microversion: 2.1 time: 0.537084 May 10 21:20:50.977106 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 39/90] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:50 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1321 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:20:51.075746 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-aec95517-1faf-4f8c-82a3-7d832f89cc68 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:51.077157 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-aec95517-1faf-4f8c-82a3-7d832f89cc68 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:51.089730 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-aec95517-1faf-4f8c-82a3-7d832f89cc68 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:51.094427 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-aec95517-1faf-4f8c-82a3-7d832f89cc68 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:51.094427 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-aec95517-1faf-4f8c-82a3-7d832f89cc68 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:51.094427 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-aec95517-1faf-4f8c-82a3-7d832f89cc68 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:51.138908 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-24a74cc0-c159-4135-8af3-42cf897928f6 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:51.138908 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-24a74cc0-c159-4135-8af3-42cf897928f6 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:51.168711 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-24a74cc0-c159-4135-8af3-42cf897928f6 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:51.170350 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-24a74cc0-c159-4135-8af3-42cf897928f6 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:51.172279 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-24a74cc0-c159-4135-8af3-42cf897928f6 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:51.175852 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-24a74cc0-c159-4135-8af3-42cf897928f6 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:51.297487 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-aec95517-1faf-4f8c-82a3-7d832f89cc68 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:51.311591 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-aec95517-1faf-4f8c-82a3-7d832f89cc68 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:51.319441 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-aec95517-1faf-4f8c-82a3-7d832f89cc68 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:51.320843 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-aec95517-1faf-4f8c-82a3-7d832f89cc68 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1339 microversion: 2.20 time: 0.250599 May 10 21:20:51.321602 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 52/91] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:20:51 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1339 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:20:51.330406 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-5ddebfc3-ada8-4230-96f0-924678e2a5df req-61cca4e8-5448-4ef5-bede-c900e6131b10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4485a817-baec-4edc-b5d8-757046ba5fa0", "tag": "328358cc-4c62-4aab-b5d9-f04bb22e58f1"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:20:51.352822 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-5ddebfc3-ada8-4230-96f0-924678e2a5df req-61cca4e8-5448-4ef5-bede-c900e6131b10 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:51.358089 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-5ddebfc3-ada8-4230-96f0-924678e2a5df req-61cca4e8-5448-4ef5-bede-c900e6131b10 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:51.388741 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-5ddebfc3-ada8-4230-96f0-924678e2a5df req-61cca4e8-5448-4ef5-bede-c900e6131b10 service nova] Creating event network-changed:328358cc-4c62-4aab-b5d9-f04bb22e58f1 for instance 4485a817-baec-4edc-b5d8-757046ba5fa0 on hv-cinder-83608 May 10 21:20:51.394238 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-5ddebfc3-ada8-4230-96f0-924678e2a5df req-61cca4e8-5448-4ef5-bede-c900e6131b10 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071374 May 10 21:20:51.395097 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 53/92] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:20:51.400841 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-1638b619-98c2-41de-b151-23a760c4c78d tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:51.401805 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-1638b619-98c2-41de-b151-23a760c4c78d tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] [instance: a840063f-5498-40c6-a89b-053d1db08ef8] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:51.409234 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1638b619-98c2-41de-b151-23a760c4c78d tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:51.409890 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1638b619-98c2-41de-b151-23a760c4c78d tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:51.411233 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1638b619-98c2-41de-b151-23a760c4c78d tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:51.412045 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1638b619-98c2-41de-b151-23a760c4c78d tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:51.648973 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-1638b619-98c2-41de-b151-23a760c4c78d tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250d6a26720a4416b62f5f7b2c646c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e738363e9f184b01a86d3459779cdfb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:51.657015 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-1638b619-98c2-41de-b151-23a760c4c78d tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] 10.222.0.25 "GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8" status: 200 len: 1315 microversion: 2.1 time: 0.260445 May 10 21:20:51.657597 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 54/93] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:51 2022] GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:51.662551 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-0f308b18-2dff-4831-a39b-26e88e1f7ab0 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:51.663155 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-0f308b18-2dff-4831-a39b-26e88e1f7ab0 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:51.672364 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0f308b18-2dff-4831-a39b-26e88e1f7ab0 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:51.672982 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0f308b18-2dff-4831-a39b-26e88e1f7ab0 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:51.673904 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0f308b18-2dff-4831-a39b-26e88e1f7ab0 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:51.674568 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0f308b18-2dff-4831-a39b-26e88e1f7ab0 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:51.740386 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-0f308b18-2dff-4831-a39b-26e88e1f7ab0 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:51.747747 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-0f308b18-2dff-4831-a39b-26e88e1f7ab0 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2" status: 200 len: 1299 microversion: 2.1 time: 0.089020 May 10 21:20:51.748312 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 55/94] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:51 2022] GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2 => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:51.886120 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-24a74cc0-c159-4135-8af3-42cf897928f6 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:51.893472 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-24a74cc0-c159-4135-8af3-42cf897928f6 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1361 microversion: 2.1 time: 0.762092 May 10 21:20:51.894054 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 40/95] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:51 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1361 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:51.993027 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-d72a1c9b-ccf2-49b0-abc4-faa640ee9c5d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:51.993612 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-d72a1c9b-ccf2-49b0-abc4-faa640ee9c5d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:51.999631 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d72a1c9b-ccf2-49b0-abc4-faa640ee9c5d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:52.000083 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d72a1c9b-ccf2-49b0-abc4-faa640ee9c5d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:52.000847 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d72a1c9b-ccf2-49b0-abc4-faa640ee9c5d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:52.001280 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d72a1c9b-ccf2-49b0-abc4-faa640ee9c5d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:52.144075 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-d72a1c9b-ccf2-49b0-abc4-faa640ee9c5d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:52.161046 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-d72a1c9b-ccf2-49b0-abc4-faa640ee9c5d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1321 microversion: 2.1 time: 0.171687 May 10 21:20:52.161699 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 56/96] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:51 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:52.346085 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4da7aa52-92b2-49cf-b90f-5464ede245de tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:52.348716 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-4da7aa52-92b2-49cf-b90f-5464ede245de tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:52.356689 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4da7aa52-92b2-49cf-b90f-5464ede245de tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:52.357503 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4da7aa52-92b2-49cf-b90f-5464ede245de tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:52.358901 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4da7aa52-92b2-49cf-b90f-5464ede245de tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:52.359548 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4da7aa52-92b2-49cf-b90f-5464ede245de tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:52.450946 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-4da7aa52-92b2-49cf-b90f-5464ede245de tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:52.460535 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-4da7aa52-92b2-49cf-b90f-5464ede245de tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:52.462050 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-4da7aa52-92b2-49cf-b90f-5464ede245de tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:52.463209 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4da7aa52-92b2-49cf-b90f-5464ede245de tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1339 microversion: 2.20 time: 0.121544 May 10 21:20:52.463768 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 41/97] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:20:52 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1339 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:20:52.673198 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-106d4b30-7940-4d2d-baa2-24a6e3d7eb4c tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:52.673808 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-106d4b30-7940-4d2d-baa2-24a6e3d7eb4c tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] [instance: a840063f-5498-40c6-a89b-053d1db08ef8] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:52.680979 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-106d4b30-7940-4d2d-baa2-24a6e3d7eb4c tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:52.681708 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-106d4b30-7940-4d2d-baa2-24a6e3d7eb4c tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:52.682516 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-106d4b30-7940-4d2d-baa2-24a6e3d7eb4c tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:52.682978 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-106d4b30-7940-4d2d-baa2-24a6e3d7eb4c tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:52.765481 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4808d8bc-e04f-4a64-826e-e04c5fee9b50 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:52.766138 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-4808d8bc-e04f-4a64-826e-e04c5fee9b50 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:52.794922 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4808d8bc-e04f-4a64-826e-e04c5fee9b50 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:52.795498 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4808d8bc-e04f-4a64-826e-e04c5fee9b50 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:52.797694 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4808d8bc-e04f-4a64-826e-e04c5fee9b50 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:52.798495 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4808d8bc-e04f-4a64-826e-e04c5fee9b50 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:52.855004 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-106d4b30-7940-4d2d-baa2-24a6e3d7eb4c tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250d6a26720a4416b62f5f7b2c646c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e738363e9f184b01a86d3459779cdfb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:52.870041 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-106d4b30-7940-4d2d-baa2-24a6e3d7eb4c tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] 10.222.0.25 "GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8" status: 200 len: 1315 microversion: 2.1 time: 0.200514 May 10 21:20:52.870841 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 57/98] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:52 2022] GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:52.913422 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-a57bf32c-422b-42a7-9fb0-dd2e37d67640 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:52.914730 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-a57bf32c-422b-42a7-9fb0-dd2e37d67640 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:52.927245 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-a57bf32c-422b-42a7-9fb0-dd2e37d67640 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:52.927938 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-a57bf32c-422b-42a7-9fb0-dd2e37d67640 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:52.928882 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-a57bf32c-422b-42a7-9fb0-dd2e37d67640 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:52.929523 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-a57bf32c-422b-42a7-9fb0-dd2e37d67640 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:53.068471 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-4808d8bc-e04f-4a64-826e-e04c5fee9b50 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:53.076205 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4808d8bc-e04f-4a64-826e-e04c5fee9b50 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2" status: 200 len: 1366 microversion: 2.1 time: 0.314677 May 10 21:20:53.076805 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 42/99] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:52 2022] GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2 => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:20:53.090617 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-a57bf32c-422b-42a7-9fb0-dd2e37d67640 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:53.099069 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-a57bf32c-422b-42a7-9fb0-dd2e37d67640 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1361 microversion: 2.1 time: 0.191343 May 10 21:20:53.100065 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 58/100] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:52 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1361 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:20:53.179640 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-22d5aeb7-36b7-4d61-b1c0-036aeaee4cf0 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:53.180344 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-22d5aeb7-36b7-4d61-b1c0-036aeaee4cf0 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:53.187075 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-22d5aeb7-36b7-4d61-b1c0-036aeaee4cf0 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:53.187751 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-22d5aeb7-36b7-4d61-b1c0-036aeaee4cf0 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:53.188534 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-22d5aeb7-36b7-4d61-b1c0-036aeaee4cf0 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:53.188967 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-22d5aeb7-36b7-4d61-b1c0-036aeaee4cf0 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:53.392684 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-22d5aeb7-36b7-4d61-b1c0-036aeaee4cf0 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:53.401617 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-22d5aeb7-36b7-4d61-b1c0-036aeaee4cf0 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1321 microversion: 2.1 time: 0.227345 May 10 21:20:53.402206 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 43/101] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:53 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:53.481464 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-38456593-521b-486a-b127-0adfdc06005e tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:53.482289 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-38456593-521b-486a-b127-0adfdc06005e tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:53.495463 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-38456593-521b-486a-b127-0adfdc06005e tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:53.496036 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-38456593-521b-486a-b127-0adfdc06005e tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:53.497044 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-38456593-521b-486a-b127-0adfdc06005e tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:53.497675 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-38456593-521b-486a-b127-0adfdc06005e tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:53.556989 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-eadbcc49-fd9d-4693-9ac8-f46985c35685 req-299a8af6-f9ff-4d6c-8911-073a1967f963 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef13be90-688a-4ebe-8b3c-c8187cf9cd70", "tag": "f5baed8c-6e2f-4a63-b64c-43aa352836ce"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:20:53.564952 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-eadbcc49-fd9d-4693-9ac8-f46985c35685 req-299a8af6-f9ff-4d6c-8911-073a1967f963 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:53.565390 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-eadbcc49-fd9d-4693-9ac8-f46985c35685 req-299a8af6-f9ff-4d6c-8911-073a1967f963 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:53.576766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-eadbcc49-fd9d-4693-9ac8-f46985c35685 req-299a8af6-f9ff-4d6c-8911-073a1967f963 service nova] Creating event network-changed:f5baed8c-6e2f-4a63-b64c-43aa352836ce for instance ef13be90-688a-4ebe-8b3c-c8187cf9cd70 on hv-cinder-83608 May 10 21:20:53.581597 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-eadbcc49-fd9d-4693-9ac8-f46985c35685 req-299a8af6-f9ff-4d6c-8911-073a1967f963 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163481 May 10 21:20:53.582189 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 59/102] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:20:53.687526 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-38456593-521b-486a-b127-0adfdc06005e tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:53.696374 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-38456593-521b-486a-b127-0adfdc06005e tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:53.698287 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-38456593-521b-486a-b127-0adfdc06005e tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:53.699708 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-38456593-521b-486a-b127-0adfdc06005e tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1407 microversion: 2.20 time: 0.222158 May 10 21:20:53.700992 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 44/103] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:20:53 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:20:53.898173 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-d7ac4c9d-deef-4683-93e2-59d69f41cca4 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:53.909791 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-d7ac4c9d-deef-4683-93e2-59d69f41cca4 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] [instance: a840063f-5498-40c6-a89b-053d1db08ef8] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:53.926681 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d7ac4c9d-deef-4683-93e2-59d69f41cca4 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:53.927256 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d7ac4c9d-deef-4683-93e2-59d69f41cca4 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:53.928776 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d7ac4c9d-deef-4683-93e2-59d69f41cca4 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:53.930123 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d7ac4c9d-deef-4683-93e2-59d69f41cca4 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:54.099038 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-ecac346f-8c2b-4637-9588-bb7ea8efc40b tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:54.101119 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-ecac346f-8c2b-4637-9588-bb7ea8efc40b tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:54.118218 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ecac346f-8c2b-4637-9588-bb7ea8efc40b tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:54.119046 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ecac346f-8c2b-4637-9588-bb7ea8efc40b tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:54.120324 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ecac346f-8c2b-4637-9588-bb7ea8efc40b tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:54.120963 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ecac346f-8c2b-4637-9588-bb7ea8efc40b tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:54.444103 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-d7ac4c9d-deef-4683-93e2-59d69f41cca4 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250d6a26720a4416b62f5f7b2c646c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e738363e9f184b01a86d3459779cdfb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:54.456640 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-d7ac4c9d-deef-4683-93e2-59d69f41cca4 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] 10.222.0.25 "GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8" status: 200 len: 1315 microversion: 2.1 time: 0.563957 May 10 21:20:54.462564 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 60/104] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:53 2022] GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8 => generated 1315 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:54.468127 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-2d0281f7-528c-4e2c-a945-8174defe650f tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:54.468870 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-2d0281f7-528c-4e2c-a945-8174defe650f tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:54.475742 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2d0281f7-528c-4e2c-a945-8174defe650f tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:54.476272 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2d0281f7-528c-4e2c-a945-8174defe650f tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:54.477120 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2d0281f7-528c-4e2c-a945-8174defe650f tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:54.477626 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2d0281f7-528c-4e2c-a945-8174defe650f tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:54.763899 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-2d0281f7-528c-4e2c-a945-8174defe650f tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:54.773573 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-2d0281f7-528c-4e2c-a945-8174defe650f tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1361 microversion: 2.1 time: 0.309581 May 10 21:20:54.774862 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 61/105] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:54 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1361 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:54.800769 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-a32cf042-968f-4d62-bd8f-af4c178af462 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:54.802163 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-a32cf042-968f-4d62-bd8f-af4c178af462 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:54.809136 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-a32cf042-968f-4d62-bd8f-af4c178af462 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:54.811660 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-a32cf042-968f-4d62-bd8f-af4c178af462 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:54.812649 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-a32cf042-968f-4d62-bd8f-af4c178af462 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:54.813248 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-a32cf042-968f-4d62-bd8f-af4c178af462 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:54.871752 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-ecac346f-8c2b-4637-9588-bb7ea8efc40b tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:54.884797 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-ecac346f-8c2b-4637-9588-bb7ea8efc40b tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2" status: 200 len: 1366 microversion: 2.1 time: 0.795305 May 10 21:20:54.887996 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 45/106] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:54 2022] GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2 => generated 1366 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:54.897117 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-1631bd0e-6fad-4bf0-b96e-27ea33487b09 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:54.899441 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-1631bd0e-6fad-4bf0-b96e-27ea33487b09 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:54.905811 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1631bd0e-6fad-4bf0-b96e-27ea33487b09 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:54.906268 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1631bd0e-6fad-4bf0-b96e-27ea33487b09 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:54.907129 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1631bd0e-6fad-4bf0-b96e-27ea33487b09 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:54.907570 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1631bd0e-6fad-4bf0-b96e-27ea33487b09 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:55.065796 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-a32cf042-968f-4d62-bd8f-af4c178af462 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:55.073716 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-a32cf042-968f-4d62-bd8f-af4c178af462 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1321 microversion: 2.1 time: 0.285957 May 10 21:20:55.074996 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 62/107] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:54 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1321 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:55.219698 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1631bd0e-6fad-4bf0-b96e-27ea33487b09 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:55.230226 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1631bd0e-6fad-4bf0-b96e-27ea33487b09 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:55.238248 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1631bd0e-6fad-4bf0-b96e-27ea33487b09 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:55.240865 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-1631bd0e-6fad-4bf0-b96e-27ea33487b09 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1407 microversion: 2.20 time: 0.351765 May 10 21:20:55.241728 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 46/108] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:20:54 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1407 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:20:55.475355 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-082db0cc-a803-49dc-8822-90c1350104c7 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:55.475968 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-082db0cc-a803-49dc-8822-90c1350104c7 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] [instance: a840063f-5498-40c6-a89b-053d1db08ef8] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:55.490599 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-082db0cc-a803-49dc-8822-90c1350104c7 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:55.491680 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-082db0cc-a803-49dc-8822-90c1350104c7 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:55.493141 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-082db0cc-a803-49dc-8822-90c1350104c7 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:55.494875 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-082db0cc-a803-49dc-8822-90c1350104c7 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:55.709721 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-082db0cc-a803-49dc-8822-90c1350104c7 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250d6a26720a4416b62f5f7b2c646c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e738363e9f184b01a86d3459779cdfb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:55.718770 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-082db0cc-a803-49dc-8822-90c1350104c7 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] 10.222.0.25 "GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8" status: 200 len: 1315 microversion: 2.1 time: 0.249213 May 10 21:20:55.724370 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 63/109] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:55 2022] GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:55.792337 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-5a03ec39-b0fb-4044-a637-cb11a6babb27 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:55.793337 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-5a03ec39-b0fb-4044-a637-cb11a6babb27 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:55.803900 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5a03ec39-b0fb-4044-a637-cb11a6babb27 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:55.805664 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5a03ec39-b0fb-4044-a637-cb11a6babb27 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:55.807480 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5a03ec39-b0fb-4044-a637-cb11a6babb27 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:55.809975 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5a03ec39-b0fb-4044-a637-cb11a6babb27 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:55.909297 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-7047165e-6c10-4bb8-a1b4-0ca27514ed6c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:55.909913 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-7047165e-6c10-4bb8-a1b4-0ca27514ed6c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:55.916590 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7047165e-6c10-4bb8-a1b4-0ca27514ed6c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:55.917037 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7047165e-6c10-4bb8-a1b4-0ca27514ed6c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:55.917819 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7047165e-6c10-4bb8-a1b4-0ca27514ed6c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:55.918254 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7047165e-6c10-4bb8-a1b4-0ca27514ed6c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:56.214369 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-5a03ec39-b0fb-4044-a637-cb11a6babb27 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:56.226854 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-5a03ec39-b0fb-4044-a637-cb11a6babb27 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1361 microversion: 2.1 time: 0.438385 May 10 21:20:56.228721 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 47/110] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:55 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1361 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:56.243549 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-0400d67d-9981-422c-b2d8-3f133c41d2ce req-d2444d78-fc2a-4e55-b22b-a6c902180b8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ec9c2a-8806-4da8-9072-ca136cfa83ad", "name": "network-vif-plugged", "status": "completed", "tag": "5408ed5b-410e-4f80-8588-0d5ecd304dea"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:20:56.255541 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-0400d67d-9981-422c-b2d8-3f133c41d2ce req-d2444d78-fc2a-4e55-b22b-a6c902180b8f service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:56.255990 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-0400d67d-9981-422c-b2d8-3f133c41d2ce req-d2444d78-fc2a-4e55-b22b-a6c902180b8f service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:56.270453 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-0400d67d-9981-422c-b2d8-3f133c41d2ce req-d2444d78-fc2a-4e55-b22b-a6c902180b8f service nova] Creating event network-vif-plugged:5408ed5b-410e-4f80-8588-0d5ecd304dea for instance e4ec9c2a-8806-4da8-9072-ca136cfa83ad on hv-cinder-83608 May 10 21:20:56.277245 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-0400d67d-9981-422c-b2d8-3f133c41d2ce req-d2444d78-fc2a-4e55-b22b-a6c902180b8f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046971 May 10 21:20:56.278737 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 48/111] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:20:56.287159 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-d18f1e65-9bda-44d3-9804-843995ee6d89 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:56.287966 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-d18f1e65-9bda-44d3-9804-843995ee6d89 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:56.294911 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d18f1e65-9bda-44d3-9804-843995ee6d89 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:56.295434 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d18f1e65-9bda-44d3-9804-843995ee6d89 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:56.296285 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d18f1e65-9bda-44d3-9804-843995ee6d89 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:56.297207 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d18f1e65-9bda-44d3-9804-843995ee6d89 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:56.309661 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-7047165e-6c10-4bb8-a1b4-0ca27514ed6c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:56.319936 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-7047165e-6c10-4bb8-a1b4-0ca27514ed6c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2" status: 200 len: 1366 microversion: 2.1 time: 0.421849 May 10 21:20:56.320800 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 64/112] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:55 2022] GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2 => generated 1366 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:20:56.341658 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-95ea6d52-f334-47f9-8962-a751549c74b4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:56.342556 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-95ea6d52-f334-47f9-8962-a751549c74b4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:56.351803 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-95ea6d52-f334-47f9-8962-a751549c74b4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:56.351803 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-95ea6d52-f334-47f9-8962-a751549c74b4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:56.352268 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-95ea6d52-f334-47f9-8962-a751549c74b4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:56.358130 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-95ea6d52-f334-47f9-8962-a751549c74b4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:56.634400 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-95ea6d52-f334-47f9-8962-a751549c74b4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:56.641174 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-d18f1e65-9bda-44d3-9804-843995ee6d89 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:56.643531 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-95ea6d52-f334-47f9-8962-a751549c74b4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:56.651085 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-95ea6d52-f334-47f9-8962-a751549c74b4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:56.652374 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-d18f1e65-9bda-44d3-9804-843995ee6d89 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1321 microversion: 2.1 time: 0.372080 May 10 21:20:56.654509 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-95ea6d52-f334-47f9-8962-a751549c74b4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1407 microversion: 2.20 time: 0.331686 May 10 21:20:56.655101 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 65/113] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:20:56 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1407 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:20:56.655619 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 49/114] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:56 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1321 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:56.670133 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-0425f9cb-e4c9-4c34-a513-6e8e2f2cc70d req-c9c0adee-0b29-42db-b032-d4b6e4fda325 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef19cfc2-aeb2-40ff-b25c-187304690869", "tag": "83ef924d-2caa-4d5a-8fb2-cd0a871c9712"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:20:56.678740 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-0425f9cb-e4c9-4c34-a513-6e8e2f2cc70d req-c9c0adee-0b29-42db-b032-d4b6e4fda325 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:56.679181 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-0425f9cb-e4c9-4c34-a513-6e8e2f2cc70d req-c9c0adee-0b29-42db-b032-d4b6e4fda325 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:56.691030 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-0425f9cb-e4c9-4c34-a513-6e8e2f2cc70d req-c9c0adee-0b29-42db-b032-d4b6e4fda325 service nova] Creating event network-changed:83ef924d-2caa-4d5a-8fb2-cd0a871c9712 for instance ef19cfc2-aeb2-40ff-b25c-187304690869 on hv-cinder-83608 May 10 21:20:56.701027 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-0425f9cb-e4c9-4c34-a513-6e8e2f2cc70d req-c9c0adee-0b29-42db-b032-d4b6e4fda325 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033896 May 10 21:20:56.705092 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 66/115] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:20:56.739350 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-407cdbef-c6b4-4e3c-8459-caf16ac41141 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:56.740042 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-407cdbef-c6b4-4e3c-8459-caf16ac41141 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] [instance: a840063f-5498-40c6-a89b-053d1db08ef8] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:56.746564 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-407cdbef-c6b4-4e3c-8459-caf16ac41141 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:56.747047 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-407cdbef-c6b4-4e3c-8459-caf16ac41141 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:56.747819 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-407cdbef-c6b4-4e3c-8459-caf16ac41141 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:56.748240 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-407cdbef-c6b4-4e3c-8459-caf16ac41141 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:57.063869 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-407cdbef-c6b4-4e3c-8459-caf16ac41141 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250d6a26720a4416b62f5f7b2c646c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e738363e9f184b01a86d3459779cdfb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:57.073252 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-407cdbef-c6b4-4e3c-8459-caf16ac41141 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] 10.222.0.25 "GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8" status: 200 len: 1315 microversion: 2.1 time: 0.341896 May 10 21:20:57.073920 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 50/116] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:56 2022] GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8 => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:57.252197 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-92f3733a-0764-4837-804d-dff5200a7032 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:57.266750 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-92f3733a-0764-4837-804d-dff5200a7032 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:57.277859 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-92f3733a-0764-4837-804d-dff5200a7032 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:57.278323 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-92f3733a-0764-4837-804d-dff5200a7032 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:57.279987 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-92f3733a-0764-4837-804d-dff5200a7032 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:57.279987 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-92f3733a-0764-4837-804d-dff5200a7032 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:57.340728 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-214b140b-e2df-4da2-b4fc-bd5107a8ddc7 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:57.340728 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-214b140b-e2df-4da2-b4fc-bd5107a8ddc7 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:57.357367 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-214b140b-e2df-4da2-b4fc-bd5107a8ddc7 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:57.357811 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-214b140b-e2df-4da2-b4fc-bd5107a8ddc7 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:57.358769 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-214b140b-e2df-4da2-b4fc-bd5107a8ddc7 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:57.359297 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-214b140b-e2df-4da2-b4fc-bd5107a8ddc7 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:57.499876 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-92f3733a-0764-4837-804d-dff5200a7032 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:57.508790 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-92f3733a-0764-4837-804d-dff5200a7032 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1361 microversion: 2.1 time: 0.265246 May 10 21:20:57.509388 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 67/117] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:57 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1361 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:57.672308 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-8ba61ee6-b3f3-4bea-a9a1-3ad51ccc3dbd tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:57.672945 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-8ba61ee6-b3f3-4bea-a9a1-3ad51ccc3dbd tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:57.681283 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8ba61ee6-b3f3-4bea-a9a1-3ad51ccc3dbd tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:57.681982 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8ba61ee6-b3f3-4bea-a9a1-3ad51ccc3dbd tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:57.683049 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8ba61ee6-b3f3-4bea-a9a1-3ad51ccc3dbd tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:57.683495 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8ba61ee6-b3f3-4bea-a9a1-3ad51ccc3dbd tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:57.784088 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-214b140b-e2df-4da2-b4fc-bd5107a8ddc7 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:57.795004 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-214b140b-e2df-4da2-b4fc-bd5107a8ddc7 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2" status: 200 len: 1366 microversion: 2.1 time: 0.461989 May 10 21:20:57.796325 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 51/118] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:57 2022] GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2 => generated 1366 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:20:57.801178 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-44293ac3-08ee-4741-b95a-3300c40841ac tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:57.802291 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-44293ac3-08ee-4741-b95a-3300c40841ac tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:57.808047 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-44293ac3-08ee-4741-b95a-3300c40841ac tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:57.808491 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-44293ac3-08ee-4741-b95a-3300c40841ac tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:57.809283 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-44293ac3-08ee-4741-b95a-3300c40841ac tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:57.809680 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-44293ac3-08ee-4741-b95a-3300c40841ac tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:57.881743 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-8ba61ee6-b3f3-4bea-a9a1-3ad51ccc3dbd tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:57.893634 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-8ba61ee6-b3f3-4bea-a9a1-3ad51ccc3dbd tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1321 microversion: 2.1 time: 0.225340 May 10 21:20:57.894219 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 68/119] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:57 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:57.959512 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-44293ac3-08ee-4741-b95a-3300c40841ac tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:57.967546 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-44293ac3-08ee-4741-b95a-3300c40841ac tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:57.969030 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-44293ac3-08ee-4741-b95a-3300c40841ac tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:57.970113 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-44293ac3-08ee-4741-b95a-3300c40841ac tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1407 microversion: 2.20 time: 0.172701 May 10 21:20:57.970702 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 52/120] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:20:57 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:20:58.090273 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-280ec679-45a1-4aa2-a781-14af1919bb52 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:58.100915 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-280ec679-45a1-4aa2-a781-14af1919bb52 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] [instance: a840063f-5498-40c6-a89b-053d1db08ef8] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:58.108551 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-280ec679-45a1-4aa2-a781-14af1919bb52 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:58.112351 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-280ec679-45a1-4aa2-a781-14af1919bb52 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:58.112351 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-280ec679-45a1-4aa2-a781-14af1919bb52 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:58.112351 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-280ec679-45a1-4aa2-a781-14af1919bb52 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:58.265764 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-280ec679-45a1-4aa2-a781-14af1919bb52 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250d6a26720a4416b62f5f7b2c646c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e738363e9f184b01a86d3459779cdfb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:58.274335 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-280ec679-45a1-4aa2-a781-14af1919bb52 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] 10.222.0.25 "GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8" status: 200 len: 1503 microversion: 2.1 time: 0.188711 May 10 21:20:58.275325 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 69/121] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:58 2022] GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8 => generated 1503 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:58.526032 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4fa638f9-cc65-49cf-b7f8-992902d02c96 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:58.527225 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-4fa638f9-cc65-49cf-b7f8-992902d02c96 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:58.533330 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4fa638f9-cc65-49cf-b7f8-992902d02c96 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:58.533775 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4fa638f9-cc65-49cf-b7f8-992902d02c96 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:58.534568 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4fa638f9-cc65-49cf-b7f8-992902d02c96 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:58.535002 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4fa638f9-cc65-49cf-b7f8-992902d02c96 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:58.717422 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-f7e4b55f-f1d6-4de5-bc4a-ff725f818361 req-54d5e0a3-142a-4446-9269-1846f20b7aca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c94150b-0bc5-4635-b761-9f16d6f0b0a2", "tag": "7866c29a-c7c3-4ff7-b763-4708fc1851a8"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:20:58.727810 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-f7e4b55f-f1d6-4de5-bc4a-ff725f818361 req-54d5e0a3-142a-4446-9269-1846f20b7aca service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:58.728344 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-f7e4b55f-f1d6-4de5-bc4a-ff725f818361 req-54d5e0a3-142a-4446-9269-1846f20b7aca service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:58.748335 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-f7e4b55f-f1d6-4de5-bc4a-ff725f818361 req-54d5e0a3-142a-4446-9269-1846f20b7aca service nova] Creating event network-changed:7866c29a-c7c3-4ff7-b763-4708fc1851a8 for instance 9c94150b-0bc5-4635-b761-9f16d6f0b0a2 on hv-cinder-83608 May 10 21:20:58.748335 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-f7e4b55f-f1d6-4de5-bc4a-ff725f818361 req-54d5e0a3-142a-4446-9269-1846f20b7aca service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035957 May 10 21:20:58.748731 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 70/122] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:20:58.749406 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-4fa638f9-cc65-49cf-b7f8-992902d02c96 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:58.766802 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4fa638f9-cc65-49cf-b7f8-992902d02c96 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1361 microversion: 2.1 time: 0.244550 May 10 21:20:58.767391 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 53/123] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:58 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1361 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:58.812904 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-8336df53-49ac-4e8b-b5b6-145f4b891702 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:58.813607 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-8336df53-49ac-4e8b-b5b6-145f4b891702 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:58.820931 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8336df53-49ac-4e8b-b5b6-145f4b891702 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:58.821381 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8336df53-49ac-4e8b-b5b6-145f4b891702 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:58.822138 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8336df53-49ac-4e8b-b5b6-145f4b891702 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:58.822621 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8336df53-49ac-4e8b-b5b6-145f4b891702 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:58.914417 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4f604a84-39fa-4077-af2a-ee3c0dfb3d54 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:58.915229 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-4f604a84-39fa-4077-af2a-ee3c0dfb3d54 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:58.921879 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4f604a84-39fa-4077-af2a-ee3c0dfb3d54 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:58.922624 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4f604a84-39fa-4077-af2a-ee3c0dfb3d54 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:58.923570 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4f604a84-39fa-4077-af2a-ee3c0dfb3d54 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:58.928074 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4f604a84-39fa-4077-af2a-ee3c0dfb3d54 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:58.988462 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-8336df53-49ac-4e8b-b5b6-145f4b891702 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:59.000237 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-8336df53-49ac-4e8b-b5b6-145f4b891702 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2" status: 200 len: 1366 microversion: 2.1 time: 0.189697 May 10 21:20:59.001205 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 71/124] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:58 2022] GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:20:59.008838 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-7ce16b7e-0b6b-428a-a4e0-9eb713a0e123 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:59.011021 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-7ce16b7e-0b6b-428a-a4e0-9eb713a0e123 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:59.037920 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7ce16b7e-0b6b-428a-a4e0-9eb713a0e123 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:59.042114 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7ce16b7e-0b6b-428a-a4e0-9eb713a0e123 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:59.043731 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7ce16b7e-0b6b-428a-a4e0-9eb713a0e123 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:59.044449 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7ce16b7e-0b6b-428a-a4e0-9eb713a0e123 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:59.178304 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-4f604a84-39fa-4077-af2a-ee3c0dfb3d54 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:59.190776 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4f604a84-39fa-4077-af2a-ee3c0dfb3d54 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1321 microversion: 2.1 time: 0.280182 May 10 21:20:59.192462 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 54/125] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:58 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1321 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:20:59.229279 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-7ce16b7e-0b6b-428a-a4e0-9eb713a0e123 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:59.242115 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-7ce16b7e-0b6b-428a-a4e0-9eb713a0e123 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:59.246287 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-7ce16b7e-0b6b-428a-a4e0-9eb713a0e123 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:59.246287 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-7ce16b7e-0b6b-428a-a4e0-9eb713a0e123 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1407 microversion: 2.20 time: 0.242843 May 10 21:20:59.246287 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 72/126] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:20:59 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:20:59.787198 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-f8148d74-2891-48f6-b6b5-d60de2084dfc tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:20:59.788541 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-f8148d74-2891-48f6-b6b5-d60de2084dfc tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:20:59.795490 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f8148d74-2891-48f6-b6b5-d60de2084dfc tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:59.796490 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f8148d74-2891-48f6-b6b5-d60de2084dfc tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:59.797487 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f8148d74-2891-48f6-b6b5-d60de2084dfc tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:20:59.798132 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f8148d74-2891-48f6-b6b5-d60de2084dfc tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:20:59.962221 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-f8148d74-2891-48f6-b6b5-d60de2084dfc tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:20:59.969473 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-f8148d74-2891-48f6-b6b5-d60de2084dfc tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1361 microversion: 2.1 time: 0.188773 May 10 21:20:59.970044 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 55/127] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:20:59 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1361 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:00.028288 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-5482f967-7470-4e91-bb07-beaa9cef80ab tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:00.028821 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-5482f967-7470-4e91-bb07-beaa9cef80ab tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:00.044102 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5482f967-7470-4e91-bb07-beaa9cef80ab tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:00.044554 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5482f967-7470-4e91-bb07-beaa9cef80ab tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:00.045332 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5482f967-7470-4e91-bb07-beaa9cef80ab tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:00.045768 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5482f967-7470-4e91-bb07-beaa9cef80ab tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:00.200805 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-59fc1ca4-ea89-40ab-8e8b-f8354dbce326 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17113879-7b6c-4628-8a66-f17ea5bfb4b4"}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:21:00.207498 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-59fc1ca4-ea89-40ab-8e8b-f8354dbce326 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] [instance: a840063f-5498-40c6-a89b-053d1db08ef8] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:00.218828 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-59fc1ca4-ea89-40ab-8e8b-f8354dbce326 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:00.218828 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-59fc1ca4-ea89-40ab-8e8b-f8354dbce326 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:00.218828 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-59fc1ca4-ea89-40ab-8e8b-f8354dbce326 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:00.218828 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-59fc1ca4-ea89-40ab-8e8b-f8354dbce326 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:00.227841 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-5482f967-7470-4e91-bb07-beaa9cef80ab tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:00.264305 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-5482f967-7470-4e91-bb07-beaa9cef80ab tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2" status: 200 len: 1366 microversion: 2.1 time: 0.242798 May 10 21:21:00.265101 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 73/128] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:00 2022] GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:00.271229 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-cf8ebb78-56b6-4196-873d-4abc68aeb931 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:00.272178 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-cf8ebb78-56b6-4196-873d-4abc68aeb931 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:00.282482 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-cf8ebb78-56b6-4196-873d-4abc68aeb931 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:00.283222 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-cf8ebb78-56b6-4196-873d-4abc68aeb931 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:00.284785 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-cf8ebb78-56b6-4196-873d-4abc68aeb931 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:00.286202 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-cf8ebb78-56b6-4196-873d-4abc68aeb931 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:00.528800 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-cf8ebb78-56b6-4196-873d-4abc68aeb931 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:00.546096 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-cf8ebb78-56b6-4196-873d-4abc68aeb931 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1321 microversion: 2.1 time: 0.279765 May 10 21:21:00.549759 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 74/129] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:00 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1321 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:00.555853 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-ca184072-bb72-486e-bb01-a46903efd8d4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:00.558115 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-ca184072-bb72-486e-bb01-a46903efd8d4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:00.566305 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ca184072-bb72-486e-bb01-a46903efd8d4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:00.569363 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ca184072-bb72-486e-bb01-a46903efd8d4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:00.569488 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ca184072-bb72-486e-bb01-a46903efd8d4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:00.570667 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ca184072-bb72-486e-bb01-a46903efd8d4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:00.759869 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-ca184072-bb72-486e-bb01-a46903efd8d4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:00.770056 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-ca184072-bb72-486e-bb01-a46903efd8d4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:00.771684 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-ca184072-bb72-486e-bb01-a46903efd8d4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:00.773067 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-ca184072-bb72-486e-bb01-a46903efd8d4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1407 microversion: 2.20 time: 0.221804 May 10 21:21:00.773638 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 75/130] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:21:00 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:21:00.789949 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-d566ee17-2bf7-4a30-9199-5985c28d2a1c req-82c678e9-5048-4b63-8248-c97c1f1ba611 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef13be90-688a-4ebe-8b3c-c8187cf9cd70", "name": "network-vif-plugged", "status": "completed", "tag": "f5baed8c-6e2f-4a63-b64c-43aa352836ce"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:21:00.798394 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-d566ee17-2bf7-4a30-9199-5985c28d2a1c req-82c678e9-5048-4b63-8248-c97c1f1ba611 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:00.798858 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-d566ee17-2bf7-4a30-9199-5985c28d2a1c req-82c678e9-5048-4b63-8248-c97c1f1ba611 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:00.810337 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-d566ee17-2bf7-4a30-9199-5985c28d2a1c req-82c678e9-5048-4b63-8248-c97c1f1ba611 service nova] Creating event network-vif-plugged:f5baed8c-6e2f-4a63-b64c-43aa352836ce for instance ef13be90-688a-4ebe-8b3c-c8187cf9cd70 on hv-cinder-83608 May 10 21:21:00.816041 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-d566ee17-2bf7-4a30-9199-5985c28d2a1c req-82c678e9-5048-4b63-8248-c97c1f1ba611 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030116 May 10 21:21:00.817054 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 76/131] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:21:00.989781 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-5bd78209-8476-4845-a386-85145560fe84 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:00.990676 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-5bd78209-8476-4845-a386-85145560fe84 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:00.996752 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5bd78209-8476-4845-a386-85145560fe84 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:00.997538 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5bd78209-8476-4845-a386-85145560fe84 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:00.997954 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5bd78209-8476-4845-a386-85145560fe84 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:00.998390 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5bd78209-8476-4845-a386-85145560fe84 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:01.215374 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-5bd78209-8476-4845-a386-85145560fe84 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:01.224389 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-5bd78209-8476-4845-a386-85145560fe84 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1361 microversion: 2.1 time: 0.239539 May 10 21:21:01.225583 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 77/132] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:00 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1361 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:21:01.281609 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-2197de01-1516-407d-9130-1bcd4edb6a68 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:01.282218 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-2197de01-1516-407d-9130-1bcd4edb6a68 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:01.288157 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2197de01-1516-407d-9130-1bcd4edb6a68 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:01.288600 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2197de01-1516-407d-9130-1bcd4edb6a68 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:01.289369 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2197de01-1516-407d-9130-1bcd4edb6a68 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:01.289800 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2197de01-1516-407d-9130-1bcd4edb6a68 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:01.431124 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-2197de01-1516-407d-9130-1bcd4edb6a68 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:01.438314 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-2197de01-1516-407d-9130-1bcd4edb6a68 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2" status: 200 len: 1366 microversion: 2.1 time: 0.160569 May 10 21:21:01.438942 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 78/133] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:01 2022] GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:21:01.564986 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-51a69747-ce3b-4efb-b168-04fcd00f3464 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:01.565584 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-51a69747-ce3b-4efb-b168-04fcd00f3464 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:01.572105 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-51a69747-ce3b-4efb-b168-04fcd00f3464 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:01.572536 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-51a69747-ce3b-4efb-b168-04fcd00f3464 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:01.577305 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-51a69747-ce3b-4efb-b168-04fcd00f3464 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:01.577305 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-51a69747-ce3b-4efb-b168-04fcd00f3464 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:01.709511 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-51a69747-ce3b-4efb-b168-04fcd00f3464 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:01.716931 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-51a69747-ce3b-4efb-b168-04fcd00f3464 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1321 microversion: 2.1 time: 0.155699 May 10 21:21:01.717706 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 79/134] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:01 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:21:01.795585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-7aef2eea-d5ca-4183-b15e-986a6fbec312 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:01.796452 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-7aef2eea-d5ca-4183-b15e-986a6fbec312 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:01.803219 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7aef2eea-d5ca-4183-b15e-986a6fbec312 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:01.803865 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7aef2eea-d5ca-4183-b15e-986a6fbec312 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:01.804834 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7aef2eea-d5ca-4183-b15e-986a6fbec312 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:01.805569 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7aef2eea-d5ca-4183-b15e-986a6fbec312 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:02.010071 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-7aef2eea-d5ca-4183-b15e-986a6fbec312 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:02.026483 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-7aef2eea-d5ca-4183-b15e-986a6fbec312 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:02.028995 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-7aef2eea-d5ca-4183-b15e-986a6fbec312 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:02.040883 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-7aef2eea-d5ca-4183-b15e-986a6fbec312 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1407 microversion: 2.20 time: 0.251290 May 10 21:21:02.050575 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 80/135] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:21:01 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1407 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:21:02.242631 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-4c24a131-954f-4543-99e8-47eafb3b4ce0 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:02.243372 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-4c24a131-954f-4543-99e8-47eafb3b4ce0 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:02.254694 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4c24a131-954f-4543-99e8-47eafb3b4ce0 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:02.255246 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4c24a131-954f-4543-99e8-47eafb3b4ce0 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:02.257126 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4c24a131-954f-4543-99e8-47eafb3b4ce0 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:02.261834 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4c24a131-954f-4543-99e8-47eafb3b4ce0 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:02.490427 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-4c24a131-954f-4543-99e8-47eafb3b4ce0 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:02.501878 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-4c24a131-954f-4543-99e8-47eafb3b4ce0 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1361 microversion: 2.1 time: 0.264150 May 10 21:21:02.512164 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 81/136] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:02 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1361 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:02.517133 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-1ad95445-ff2b-4c07-b48e-dbda785428c3 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:02.524009 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-1ad95445-ff2b-4c07-b48e-dbda785428c3 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:02.533929 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1ad95445-ff2b-4c07-b48e-dbda785428c3 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:02.534520 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1ad95445-ff2b-4c07-b48e-dbda785428c3 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:02.538000 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1ad95445-ff2b-4c07-b48e-dbda785428c3 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:02.538000 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1ad95445-ff2b-4c07-b48e-dbda785428c3 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:02.709074 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-59fc1ca4-ea89-40ab-8e8b-f8354dbce326 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] 10.222.0.25 "POST /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.511372 May 10 21:21:02.716018 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 56/137] 10.222.0.25 () {60 vars in 1322 bytes} [Tue May 10 21:21:00 2022] POST /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8/os-volume_attachments => generated 194 bytes in 2522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:21:02.732925 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-1ad95445-ff2b-4c07-b48e-dbda785428c3 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:02.742961 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-1ad95445-ff2b-4c07-b48e-dbda785428c3 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2" status: 200 len: 1366 microversion: 2.1 time: 0.229446 May 10 21:21:02.743225 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-48ca8fd1-cebe-4094-87df-cf272a8a1151 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:02.743837 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 82/138] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:02 2022] GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2 => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:02.745704 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-48ca8fd1-cebe-4094-87df-cf272a8a1151 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:02.752961 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-48ca8fd1-cebe-4094-87df-cf272a8a1151 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:02.757661 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-48ca8fd1-cebe-4094-87df-cf272a8a1151 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:02.757661 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-48ca8fd1-cebe-4094-87df-cf272a8a1151 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:02.757661 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-48ca8fd1-cebe-4094-87df-cf272a8a1151 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:02.831783 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-51438074-5f5b-4c71-a62e-28b2a008ff39 req-f8c40f14-ca84-4743-b33c-b0330535c1cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4485a817-baec-4edc-b5d8-757046ba5fa0", "name": "network-vif-plugged", "status": "completed", "tag": "328358cc-4c62-4aab-b5d9-f04bb22e58f1"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:21:02.841078 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-51438074-5f5b-4c71-a62e-28b2a008ff39 req-f8c40f14-ca84-4743-b33c-b0330535c1cf service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:02.855601 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-51438074-5f5b-4c71-a62e-28b2a008ff39 req-f8c40f14-ca84-4743-b33c-b0330535c1cf service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:02.875291 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-51438074-5f5b-4c71-a62e-28b2a008ff39 req-f8c40f14-ca84-4743-b33c-b0330535c1cf service nova] Creating event network-vif-plugged:328358cc-4c62-4aab-b5d9-f04bb22e58f1 for instance 4485a817-baec-4edc-b5d8-757046ba5fa0 on hv-cinder-83608 May 10 21:21:02.886459 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-51438074-5f5b-4c71-a62e-28b2a008ff39 req-f8c40f14-ca84-4743-b33c-b0330535c1cf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058285 May 10 21:21:02.887227 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 83/139] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:21:02.914175 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-48ca8fd1-cebe-4094-87df-cf272a8a1151 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:02.922382 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-48ca8fd1-cebe-4094-87df-cf272a8a1151 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1321 microversion: 2.1 time: 0.190566 May 10 21:21:02.923146 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 57/140] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:02 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:03.064027 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-b6623db0-e146-43f4-8c21-8cad2e27170f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:03.065902 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-b6623db0-e146-43f4-8c21-8cad2e27170f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:03.078625 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b6623db0-e146-43f4-8c21-8cad2e27170f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:03.079069 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b6623db0-e146-43f4-8c21-8cad2e27170f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:03.079904 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b6623db0-e146-43f4-8c21-8cad2e27170f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:03.080676 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b6623db0-e146-43f4-8c21-8cad2e27170f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:03.256832 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-b6623db0-e146-43f4-8c21-8cad2e27170f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:03.267081 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-b6623db0-e146-43f4-8c21-8cad2e27170f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:03.269037 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-b6623db0-e146-43f4-8c21-8cad2e27170f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:03.271085 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-b6623db0-e146-43f4-8c21-8cad2e27170f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1407 microversion: 2.20 time: 0.213558 May 10 21:21:03.271893 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 84/141] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:21:03 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:21:03.518874 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-2065cd47-aaed-45a8-be75-9980cd486ef8 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:03.520080 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-2065cd47-aaed-45a8-be75-9980cd486ef8 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:03.526644 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2065cd47-aaed-45a8-be75-9980cd486ef8 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:03.527093 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2065cd47-aaed-45a8-be75-9980cd486ef8 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:03.527861 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2065cd47-aaed-45a8-be75-9980cd486ef8 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:03.528288 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2065cd47-aaed-45a8-be75-9980cd486ef8 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:03.732352 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2065cd47-aaed-45a8-be75-9980cd486ef8 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:03.741715 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-2065cd47-aaed-45a8-be75-9980cd486ef8 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1361 microversion: 2.1 time: 0.226669 May 10 21:21:03.743597 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 58/142] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:03 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1361 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:03.761675 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-f2c93e43-e6ae-46ec-9285-9f05dd1c9e8c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:03.762738 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-f2c93e43-e6ae-46ec-9285-9f05dd1c9e8c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:03.777089 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f2c93e43-e6ae-46ec-9285-9f05dd1c9e8c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:03.777514 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f2c93e43-e6ae-46ec-9285-9f05dd1c9e8c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:03.778489 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f2c93e43-e6ae-46ec-9285-9f05dd1c9e8c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:03.779062 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f2c93e43-e6ae-46ec-9285-9f05dd1c9e8c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:03.940184 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-713daa9b-ab34-458b-92bd-6bbd557467f1 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:03.941129 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-713daa9b-ab34-458b-92bd-6bbd557467f1 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:03.945052 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-f2c93e43-e6ae-46ec-9285-9f05dd1c9e8c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:03.947999 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-713daa9b-ab34-458b-92bd-6bbd557467f1 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:03.948515 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-713daa9b-ab34-458b-92bd-6bbd557467f1 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:03.949295 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-713daa9b-ab34-458b-92bd-6bbd557467f1 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:03.950534 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-713daa9b-ab34-458b-92bd-6bbd557467f1 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:03.956747 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-f2c93e43-e6ae-46ec-9285-9f05dd1c9e8c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2" status: 200 len: 1366 microversion: 2.1 time: 0.197951 May 10 21:21:03.962558 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 85/143] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:03 2022] GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2 => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:04.134219 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-713daa9b-ab34-458b-92bd-6bbd557467f1 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:04.143536 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-713daa9b-ab34-458b-92bd-6bbd557467f1 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1321 microversion: 2.1 time: 0.207122 May 10 21:21:04.144360 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 59/144] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:03 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:04.290851 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-3469189b-cebf-41c1-9933-5b49e2c140ad tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:04.291455 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-3469189b-cebf-41c1-9933-5b49e2c140ad tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:04.297528 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3469189b-cebf-41c1-9933-5b49e2c140ad tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:04.298155 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3469189b-cebf-41c1-9933-5b49e2c140ad tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:04.298956 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3469189b-cebf-41c1-9933-5b49e2c140ad tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:04.299383 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3469189b-cebf-41c1-9933-5b49e2c140ad tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:04.435512 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-3469189b-cebf-41c1-9933-5b49e2c140ad tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:04.445040 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-3469189b-cebf-41c1-9933-5b49e2c140ad tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:04.447032 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-3469189b-cebf-41c1-9933-5b49e2c140ad tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:04.448346 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-3469189b-cebf-41c1-9933-5b49e2c140ad tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1407 microversion: 2.20 time: 0.162830 May 10 21:21:04.449878 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 86/145] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:21:04 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:21:04.759138 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-72530a23-993c-4c8e-8bc6-e089e2f7af39 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:04.760081 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-72530a23-993c-4c8e-8bc6-e089e2f7af39 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:04.775757 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-72530a23-993c-4c8e-8bc6-e089e2f7af39 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:04.776580 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-72530a23-993c-4c8e-8bc6-e089e2f7af39 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:04.777461 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-72530a23-993c-4c8e-8bc6-e089e2f7af39 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:04.777981 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-72530a23-993c-4c8e-8bc6-e089e2f7af39 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:04.906689 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-0cee8c6b-ef55-4a95-a61a-de835f9663c7 req-2ea61fe0-5f6c-4f1c-ae31-ffacc63856c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c94150b-0bc5-4635-b761-9f16d6f0b0a2", "name": "network-vif-plugged", "status": "completed", "tag": "7866c29a-c7c3-4ff7-b763-4708fc1851a8"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:21:04.927245 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-0cee8c6b-ef55-4a95-a61a-de835f9663c7 req-2ea61fe0-5f6c-4f1c-ae31-ffacc63856c4 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:04.927868 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-0cee8c6b-ef55-4a95-a61a-de835f9663c7 req-2ea61fe0-5f6c-4f1c-ae31-ffacc63856c4 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:04.940336 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-0cee8c6b-ef55-4a95-a61a-de835f9663c7 req-2ea61fe0-5f6c-4f1c-ae31-ffacc63856c4 service nova] Creating event network-vif-plugged:7866c29a-c7c3-4ff7-b763-4708fc1851a8 for instance 9c94150b-0bc5-4635-b761-9f16d6f0b0a2 on hv-cinder-83608 May 10 21:21:04.946017 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-0cee8c6b-ef55-4a95-a61a-de835f9663c7 req-2ea61fe0-5f6c-4f1c-ae31-ffacc63856c4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042841 May 10 21:21:04.947129 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 87/146] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:21:04.979033 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-72530a23-993c-4c8e-8bc6-e089e2f7af39 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:04.987374 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-72530a23-993c-4c8e-8bc6-e089e2f7af39 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1546 microversion: 2.1 time: 0.232023 May 10 21:21:04.988055 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 60/147] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:04 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1546 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:04.992931 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-345e02ca-faa9-4e38-866d-47b8ae865efd tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:05.001830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-345e02ca-faa9-4e38-866d-47b8ae865efd tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:05.010372 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-345e02ca-faa9-4e38-866d-47b8ae865efd tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:05.010922 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-345e02ca-faa9-4e38-866d-47b8ae865efd tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:05.011663 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-345e02ca-faa9-4e38-866d-47b8ae865efd tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:05.012087 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-345e02ca-faa9-4e38-866d-47b8ae865efd tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:05.014658 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e8ccc2b2-00b1-42ac-86d4-bc65ad9d6032 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:05.015144 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-e8ccc2b2-00b1-42ac-86d4-bc65ad9d6032 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:05.022420 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e8ccc2b2-00b1-42ac-86d4-bc65ad9d6032 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:05.022905 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e8ccc2b2-00b1-42ac-86d4-bc65ad9d6032 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:05.023709 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e8ccc2b2-00b1-42ac-86d4-bc65ad9d6032 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:05.024070 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e8ccc2b2-00b1-42ac-86d4-bc65ad9d6032 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:05.135580 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-e8ccc2b2-00b1-42ac-86d4-bc65ad9d6032 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.124717 May 10 21:21:05.136164 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 61/148] 10.222.0.25 () {58 vars in 1274 bytes} [Tue May 10 21:21:05 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70/os-interface => generated 284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:21:05.161499 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a443208f-1dc5-4b85-8471-7a549db70a19 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:05.162161 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-a443208f-1dc5-4b85-8471-7a549db70a19 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:05.179746 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a443208f-1dc5-4b85-8471-7a549db70a19 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:05.183331 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a443208f-1dc5-4b85-8471-7a549db70a19 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:05.183331 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a443208f-1dc5-4b85-8471-7a549db70a19 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:05.183331 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a443208f-1dc5-4b85-8471-7a549db70a19 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:05.204951 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-345e02ca-faa9-4e38-866d-47b8ae865efd tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:05.217137 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-345e02ca-faa9-4e38-866d-47b8ae865efd tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2" status: 200 len: 1366 microversion: 2.1 time: 0.244735 May 10 21:21:05.218799 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 88/149] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:04 2022] GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2 => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:05.468883 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-339f17d5-2158-4322-9c97-f1b146ccd564 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:05.478623 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-339f17d5-2158-4322-9c97-f1b146ccd564 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:05.487665 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-339f17d5-2158-4322-9c97-f1b146ccd564 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:05.488200 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-339f17d5-2158-4322-9c97-f1b146ccd564 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:05.489200 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-339f17d5-2158-4322-9c97-f1b146ccd564 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:05.489633 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-339f17d5-2158-4322-9c97-f1b146ccd564 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:05.494463 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-a443208f-1dc5-4b85-8471-7a549db70a19 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:05.501792 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-a443208f-1dc5-4b85-8471-7a549db70a19 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1321 microversion: 2.1 time: 0.344645 May 10 21:21:05.502376 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 62/150] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:05 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1321 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:05.636784 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-339f17d5-2158-4322-9c97-f1b146ccd564 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:05.648256 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-339f17d5-2158-4322-9c97-f1b146ccd564 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:05.650111 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-339f17d5-2158-4322-9c97-f1b146ccd564 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:05.652331 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-339f17d5-2158-4322-9c97-f1b146ccd564 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1407 microversion: 2.20 time: 0.187166 May 10 21:21:05.652952 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 89/151] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:21:05 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:21:06.234789 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-fb2da396-751c-4535-9e9a-84a1381209e6 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:06.235394 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-fb2da396-751c-4535-9e9a-84a1381209e6 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:06.242635 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fb2da396-751c-4535-9e9a-84a1381209e6 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:06.243073 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fb2da396-751c-4535-9e9a-84a1381209e6 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:06.243831 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fb2da396-751c-4535-9e9a-84a1381209e6 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:06.244255 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fb2da396-751c-4535-9e9a-84a1381209e6 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:06.519021 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-e8f9941b-15a4-4ed0-a01d-3008d03d3404 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:06.525676 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-e8f9941b-15a4-4ed0-a01d-3008d03d3404 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:06.527626 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e8f9941b-15a4-4ed0-a01d-3008d03d3404 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:06.528135 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e8f9941b-15a4-4ed0-a01d-3008d03d3404 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:06.528976 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e8f9941b-15a4-4ed0-a01d-3008d03d3404 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:06.529470 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e8f9941b-15a4-4ed0-a01d-3008d03d3404 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:06.658692 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-fb2da396-751c-4535-9e9a-84a1381209e6 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:06.671450 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-fb2da396-751c-4535-9e9a-84a1381209e6 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2" status: 200 len: 1366 microversion: 2.1 time: 0.439993 May 10 21:21:06.683276 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 63/152] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:06 2022] GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2 => generated 1366 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:06.690611 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-395a4335-acc9-44be-aa58-eb9861f4e738 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:06.691420 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-395a4335-acc9-44be-aa58-eb9861f4e738 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:06.694187 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-e8f9941b-15a4-4ed0-a01d-3008d03d3404 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:06.698600 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-395a4335-acc9-44be-aa58-eb9861f4e738 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:06.699240 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-395a4335-acc9-44be-aa58-eb9861f4e738 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:06.700182 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-395a4335-acc9-44be-aa58-eb9861f4e738 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:06.700766 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-395a4335-acc9-44be-aa58-eb9861f4e738 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:06.703594 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-e8f9941b-15a4-4ed0-a01d-3008d03d3404 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1516 microversion: 2.1 time: 0.188334 May 10 21:21:06.716622 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 90/153] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:06 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1516 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:21:06.721669 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-fa12059b-4b50-4466-bc55-3c196a32a67c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:21:06.723508 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-fa12059b-4b50-4466-bc55-3c196a32a67c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:06.731665 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-fa12059b-4b50-4466-bc55-3c196a32a67c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:06.732114 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-fa12059b-4b50-4466-bc55-3c196a32a67c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:06.732887 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-fa12059b-4b50-4466-bc55-3c196a32a67c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:06.733377 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-fa12059b-4b50-4466-bc55-3c196a32a67c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:06.799365 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.objects.instance [None req-fa12059b-4b50-4466-bc55-3c196a32a67c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lazy-loading 'flavor' on Instance uuid 4485a817-baec-4edc-b5d8-757046ba5fa0 {{(pid=117678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:21:06.997783 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-395a4335-acc9-44be-aa58-eb9861f4e738 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:07.008831 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-395a4335-acc9-44be-aa58-eb9861f4e738 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:07.028820 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-395a4335-acc9-44be-aa58-eb9861f4e738 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:07.030636 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-395a4335-acc9-44be-aa58-eb9861f4e738 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1407 microversion: 2.20 time: 0.346057 May 10 21:21:07.046717 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 64/154] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:21:06 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1407 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:21:07.056368 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-b807c90e-8c58-4449-9434-b0999bbd702b req-f1dba7d0-d173-4abe-8dce-e7d6209fcfe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef19cfc2-aeb2-40ff-b25c-187304690869", "name": "network-vif-plugged", "status": "completed", "tag": "83ef924d-2caa-4d5a-8fb2-cd0a871c9712"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:21:07.072920 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-b807c90e-8c58-4449-9434-b0999bbd702b req-f1dba7d0-d173-4abe-8dce-e7d6209fcfe2 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:07.073356 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-b807c90e-8c58-4449-9434-b0999bbd702b req-f1dba7d0-d173-4abe-8dce-e7d6209fcfe2 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:07.132574 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-b807c90e-8c58-4449-9434-b0999bbd702b req-f1dba7d0-d173-4abe-8dce-e7d6209fcfe2 service nova] Creating event network-vif-plugged:83ef924d-2caa-4d5a-8fb2-cd0a871c9712 for instance ef19cfc2-aeb2-40ff-b25c-187304690869 on hv-cinder-83608 May 10 21:21:07.132574 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-b807c90e-8c58-4449-9434-b0999bbd702b req-f1dba7d0-d173-4abe-8dce-e7d6209fcfe2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094333 May 10 21:21:07.133176 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 65/155] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:21:07.182625 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-834517f6-bba5-4b84-8b5c-6ff9da1ad4be req-71179d7b-b577-4442-8d43-42237822006d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef13be90-688a-4ebe-8b3c-c8187cf9cd70", "tag": "f5baed8c-6e2f-4a63-b64c-43aa352836ce"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:21:07.192054 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-834517f6-bba5-4b84-8b5c-6ff9da1ad4be req-71179d7b-b577-4442-8d43-42237822006d service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:07.192682 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-834517f6-bba5-4b84-8b5c-6ff9da1ad4be req-71179d7b-b577-4442-8d43-42237822006d service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:07.207352 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-834517f6-bba5-4b84-8b5c-6ff9da1ad4be req-71179d7b-b577-4442-8d43-42237822006d service nova] Creating event network-changed:f5baed8c-6e2f-4a63-b64c-43aa352836ce for instance ef13be90-688a-4ebe-8b3c-c8187cf9cd70 on hv-cinder-83608 May 10 21:21:07.208091 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-fa12059b-4b50-4466-bc55-3c196a32a67c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "POST /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0/action" status: 200 len: 32 microversion: 2.1 time: 0.490158 May 10 21:21:07.212633 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 91/156] 10.222.0.25 () {60 vars in 1277 bytes} [Tue May 10 21:21:06 2022] POST /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0/action => generated 32 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 21:21:07.226637 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-10724666-a873-454b-8ba1-50419d8eb763 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:07.236975 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-834517f6-bba5-4b84-8b5c-6ff9da1ad4be req-71179d7b-b577-4442-8d43-42237822006d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058418 May 10 21:21:07.240852 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-10724666-a873-454b-8ba1-50419d8eb763 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:07.241480 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 66/157] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:21:07.258531 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-10724666-a873-454b-8ba1-50419d8eb763 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:07.258987 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-10724666-a873-454b-8ba1-50419d8eb763 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:07.262060 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-10724666-a873-454b-8ba1-50419d8eb763 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:07.262060 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-10724666-a873-454b-8ba1-50419d8eb763 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:07.467984 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-10724666-a873-454b-8ba1-50419d8eb763 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:07.477918 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-10724666-a873-454b-8ba1-50419d8eb763 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1522 microversion: 2.1 time: 0.262169 May 10 21:21:07.489680 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 92/158] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:07 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:07.692319 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-383b02ee-6493-47d0-a3e2-115b82ded12b tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:07.693232 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-383b02ee-6493-47d0-a3e2-115b82ded12b tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:07.700070 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-383b02ee-6493-47d0-a3e2-115b82ded12b tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:07.707299 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-383b02ee-6493-47d0-a3e2-115b82ded12b tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:07.708737 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-383b02ee-6493-47d0-a3e2-115b82ded12b tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:07.710518 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-383b02ee-6493-47d0-a3e2-115b82ded12b tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:07.989103 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-383b02ee-6493-47d0-a3e2-115b82ded12b tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:07.999722 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-383b02ee-6493-47d0-a3e2-115b82ded12b tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2" status: 200 len: 1366 microversion: 2.1 time: 0.314195 May 10 21:21:08.000929 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 67/159] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:07 2022] GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2 => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:08.057875 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-b16c0009-679c-4063-8e1c-6d38fab55113 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:08.061449 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-b16c0009-679c-4063-8e1c-6d38fab55113 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:08.066784 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b16c0009-679c-4063-8e1c-6d38fab55113 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:08.067649 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b16c0009-679c-4063-8e1c-6d38fab55113 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:08.069475 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b16c0009-679c-4063-8e1c-6d38fab55113 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:08.070067 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b16c0009-679c-4063-8e1c-6d38fab55113 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:08.274167 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-b16c0009-679c-4063-8e1c-6d38fab55113 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:08.282409 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-b16c0009-679c-4063-8e1c-6d38fab55113 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:08.283913 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-b16c0009-679c-4063-8e1c-6d38fab55113 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:08.285825 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-b16c0009-679c-4063-8e1c-6d38fab55113 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1407 microversion: 2.20 time: 0.231878 May 10 21:21:08.286940 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 93/160] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:21:08 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:21:08.499361 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-5d234bc1-0170-4a83-9e45-ec3df36610eb tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:08.500783 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-5d234bc1-0170-4a83-9e45-ec3df36610eb tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:08.507060 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5d234bc1-0170-4a83-9e45-ec3df36610eb tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:08.507523 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5d234bc1-0170-4a83-9e45-ec3df36610eb tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:08.508439 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5d234bc1-0170-4a83-9e45-ec3df36610eb tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:08.509051 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5d234bc1-0170-4a83-9e45-ec3df36610eb tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:08.911407 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-5d234bc1-0170-4a83-9e45-ec3df36610eb tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:08.919057 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-5d234bc1-0170-4a83-9e45-ec3df36610eb tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1522 microversion: 2.1 time: 0.427697 May 10 21:21:08.919854 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 68/161] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:08 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1522 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:09.022094 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-7a517e93-a941-4443-bd31-8b5fd94bb4dc tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:09.022833 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-7a517e93-a941-4443-bd31-8b5fd94bb4dc tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:09.028866 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7a517e93-a941-4443-bd31-8b5fd94bb4dc tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:09.033856 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7a517e93-a941-4443-bd31-8b5fd94bb4dc tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:09.033856 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7a517e93-a941-4443-bd31-8b5fd94bb4dc tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:09.033856 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7a517e93-a941-4443-bd31-8b5fd94bb4dc tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:09.265773 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-7a517e93-a941-4443-bd31-8b5fd94bb4dc tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:09.280651 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-7a517e93-a941-4443-bd31-8b5fd94bb4dc tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2" status: 200 len: 1556 microversion: 2.1 time: 0.262715 May 10 21:21:09.281843 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 94/162] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:09 2022] GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2 => generated 1556 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:09.301755 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-d1bfd6bc-6fe2-481c-aece-27965ff1c978 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:09.304651 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-d1bfd6bc-6fe2-481c-aece-27965ff1c978 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:09.313806 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-f42f327f-a6e2-4f65-ac3c-a1c19cfc6838 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:09.320796 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d1bfd6bc-6fe2-481c-aece-27965ff1c978 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:09.321353 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d1bfd6bc-6fe2-481c-aece-27965ff1c978 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:09.322363 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d1bfd6bc-6fe2-481c-aece-27965ff1c978 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:09.322904 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d1bfd6bc-6fe2-481c-aece-27965ff1c978 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:09.324692 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-f42f327f-a6e2-4f65-ac3c-a1c19cfc6838 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:09.338119 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f42f327f-a6e2-4f65-ac3c-a1c19cfc6838 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:09.339510 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f42f327f-a6e2-4f65-ac3c-a1c19cfc6838 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:09.341374 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f42f327f-a6e2-4f65-ac3c-a1c19cfc6838 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:09.343616 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f42f327f-a6e2-4f65-ac3c-a1c19cfc6838 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:09.498133 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-d1bfd6bc-6fe2-481c-aece-27965ff1c978 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.200385 May 10 21:21:09.499163 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 69/163] 10.222.0.25 () {58 vars in 1274 bytes} [Tue May 10 21:21:09 2022] GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2/os-interface => generated 284 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:21:09.583485 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-f42f327f-a6e2-4f65-ac3c-a1c19cfc6838 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:09.591467 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-f42f327f-a6e2-4f65-ac3c-a1c19cfc6838 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:09.593179 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-f42f327f-a6e2-4f65-ac3c-a1c19cfc6838 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:09.594773 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-f42f327f-a6e2-4f65-ac3c-a1c19cfc6838 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1407 microversion: 2.20 time: 0.286967 May 10 21:21:09.595412 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 95/164] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:21:09 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1407 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:21:09.936682 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-aedb5db9-43b6-448e-bcb8-81631068f952 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:09.937284 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-aedb5db9-43b6-448e-bcb8-81631068f952 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:09.943888 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-aedb5db9-43b6-448e-bcb8-81631068f952 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:09.944541 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-aedb5db9-43b6-448e-bcb8-81631068f952 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:09.945304 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-aedb5db9-43b6-448e-bcb8-81631068f952 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:09.945729 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-aedb5db9-43b6-448e-bcb8-81631068f952 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:10.548403 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-aedb5db9-43b6-448e-bcb8-81631068f952 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:10.558039 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-aedb5db9-43b6-448e-bcb8-81631068f952 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1522 microversion: 2.1 time: 0.625571 May 10 21:21:10.558962 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 70/165] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:09 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1522 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:10.617618 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-96be692f-21c3-4de9-91d4-e13db273b000 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:10.617618 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-96be692f-21c3-4de9-91d4-e13db273b000 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:10.623310 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-96be692f-21c3-4de9-91d4-e13db273b000 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:10.627119 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-96be692f-21c3-4de9-91d4-e13db273b000 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:10.627948 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-96be692f-21c3-4de9-91d4-e13db273b000 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:10.629346 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-96be692f-21c3-4de9-91d4-e13db273b000 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:10.787148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-96be692f-21c3-4de9-91d4-e13db273b000 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:10.798983 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-96be692f-21c3-4de9-91d4-e13db273b000 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:10.800971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-96be692f-21c3-4de9-91d4-e13db273b000 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:10.802409 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-96be692f-21c3-4de9-91d4-e13db273b000 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1599 microversion: 2.20 time: 0.192197 May 10 21:21:10.803438 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 96/166] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:21:10 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1599 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:21:10.820854 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-8f8057a6-de67-4d99-86ca-29be3e0cae03 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:10.822769 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-8f8057a6-de67-4d99-86ca-29be3e0cae03 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:10.830030 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8f8057a6-de67-4d99-86ca-29be3e0cae03 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:10.834041 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8f8057a6-de67-4d99-86ca-29be3e0cae03 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:10.835049 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8f8057a6-de67-4d99-86ca-29be3e0cae03 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:10.835635 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8f8057a6-de67-4d99-86ca-29be3e0cae03 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:11.028506 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-8f8057a6-de67-4d99-86ca-29be3e0cae03 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.211467 May 10 21:21:11.029529 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 71/167] 10.222.0.25 () {60 vars in 1315 bytes} [Tue May 10 21:21:10 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869/os-interface => generated 284 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:21:11.517379 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-f77301ef-2df7-408f-bce9-0bd21c7c91b0 req-e8c6e73f-d3f5-4f8b-9a7f-d108a6cbe7cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c94150b-0bc5-4635-b761-9f16d6f0b0a2", "tag": "7866c29a-c7c3-4ff7-b763-4708fc1851a8"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:21:11.526876 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-f77301ef-2df7-408f-bce9-0bd21c7c91b0 req-e8c6e73f-d3f5-4f8b-9a7f-d108a6cbe7cc service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:11.527300 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-f77301ef-2df7-408f-bce9-0bd21c7c91b0 req-e8c6e73f-d3f5-4f8b-9a7f-d108a6cbe7cc service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:11.545749 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-f77301ef-2df7-408f-bce9-0bd21c7c91b0 req-e8c6e73f-d3f5-4f8b-9a7f-d108a6cbe7cc service nova] Creating event network-changed:7866c29a-c7c3-4ff7-b763-4708fc1851a8 for instance 9c94150b-0bc5-4635-b761-9f16d6f0b0a2 on hv-cinder-83608 May 10 21:21:11.561777 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-f77301ef-2df7-408f-bce9-0bd21c7c91b0 req-e8c6e73f-d3f5-4f8b-9a7f-d108a6cbe7cc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045501 May 10 21:21:11.564253 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 97/168] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:21:11.576042 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6fa4220b-c342-4c8e-bd70-903c53647392 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:11.577637 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-6fa4220b-c342-4c8e-bd70-903c53647392 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:11.586364 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6fa4220b-c342-4c8e-bd70-903c53647392 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:11.589011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6fa4220b-c342-4c8e-bd70-903c53647392 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:11.591119 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6fa4220b-c342-4c8e-bd70-903c53647392 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:11.592182 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6fa4220b-c342-4c8e-bd70-903c53647392 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:11.783064 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-6fa4220b-c342-4c8e-bd70-903c53647392 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:11.792285 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-6fa4220b-c342-4c8e-bd70-903c53647392 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1522 microversion: 2.1 time: 0.220192 May 10 21:21:11.804492 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 72/169] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:11 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:12.809830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-04663a10-9ed0-47b2-b21f-aecaabad8c09 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:12.810561 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-04663a10-9ed0-47b2-b21f-aecaabad8c09 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:12.817253 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-04663a10-9ed0-47b2-b21f-aecaabad8c09 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:12.817905 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-04663a10-9ed0-47b2-b21f-aecaabad8c09 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:12.819392 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-04663a10-9ed0-47b2-b21f-aecaabad8c09 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:12.819831 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-04663a10-9ed0-47b2-b21f-aecaabad8c09 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:12.959172 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-fb1ae6df-27c9-46a3-b519-d70b676d0c30 req-6e4b3a9c-484f-444b-90a3-1a6dd0f5698e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef19cfc2-aeb2-40ff-b25c-187304690869", "tag": "83ef924d-2caa-4d5a-8fb2-cd0a871c9712"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:21:12.970573 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-fb1ae6df-27c9-46a3-b519-d70b676d0c30 req-6e4b3a9c-484f-444b-90a3-1a6dd0f5698e service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:12.975612 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-fb1ae6df-27c9-46a3-b519-d70b676d0c30 req-6e4b3a9c-484f-444b-90a3-1a6dd0f5698e service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:13.005252 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-04663a10-9ed0-47b2-b21f-aecaabad8c09 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:13.006074 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-fb1ae6df-27c9-46a3-b519-d70b676d0c30 req-6e4b3a9c-484f-444b-90a3-1a6dd0f5698e service nova] Creating event network-changed:83ef924d-2caa-4d5a-8fb2-cd0a871c9712 for instance ef19cfc2-aeb2-40ff-b25c-187304690869 on hv-cinder-83608 May 10 21:21:13.013090 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-fb1ae6df-27c9-46a3-b519-d70b676d0c30 req-6e4b3a9c-484f-444b-90a3-1a6dd0f5698e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058033 May 10 21:21:13.014683 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 73/170] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:21:13.017228 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-04663a10-9ed0-47b2-b21f-aecaabad8c09 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1522 microversion: 2.1 time: 0.211489 May 10 21:21:13.031447 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 98/171] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:12 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:14.040964 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-15a85aef-06eb-4046-8d19-32eaab1ed9a7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:14.041579 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-15a85aef-06eb-4046-8d19-32eaab1ed9a7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:14.048877 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-15a85aef-06eb-4046-8d19-32eaab1ed9a7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:14.049574 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-15a85aef-06eb-4046-8d19-32eaab1ed9a7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:14.051113 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-15a85aef-06eb-4046-8d19-32eaab1ed9a7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:14.051802 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-15a85aef-06eb-4046-8d19-32eaab1ed9a7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:14.603287 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-15a85aef-06eb-4046-8d19-32eaab1ed9a7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:14.610547 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-15a85aef-06eb-4046-8d19-32eaab1ed9a7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1522 microversion: 2.1 time: 0.574635 May 10 21:21:14.612950 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 74/172] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:14 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1522 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:14.892968 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-d006569e-e117-4124-8241-2eccb5eba56c tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:14.893438 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-d006569e-e117-4124-8241-2eccb5eba56c tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] [instance: a840063f-5498-40c6-a89b-053d1db08ef8] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:14.899801 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d006569e-e117-4124-8241-2eccb5eba56c tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:14.900241 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d006569e-e117-4124-8241-2eccb5eba56c tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:14.901221 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d006569e-e117-4124-8241-2eccb5eba56c tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:14.901798 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d006569e-e117-4124-8241-2eccb5eba56c tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:14.929391 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-d006569e-e117-4124-8241-2eccb5eba56c tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] [instance: a840063f-5498-40c6-a89b-053d1db08ef8] Going to try to terminate instance {{(pid=117678) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 21:21:15.310004 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-d006569e-e117-4124-8241-2eccb5eba56c tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8" status: 204 len: 0 microversion: 2.1 time: 0.420892 May 10 21:21:15.311212 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 99/173] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 10 21:21:14 2022] DELETE /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 21:21:15.321592 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-9e68d1a1-5bcb-459e-a302-a0a76c763171 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:15.321592 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-9e68d1a1-5bcb-459e-a302-a0a76c763171 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] [instance: a840063f-5498-40c6-a89b-053d1db08ef8] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:15.327317 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9e68d1a1-5bcb-459e-a302-a0a76c763171 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:15.327995 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9e68d1a1-5bcb-459e-a302-a0a76c763171 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:15.328778 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9e68d1a1-5bcb-459e-a302-a0a76c763171 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:15.329210 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9e68d1a1-5bcb-459e-a302-a0a76c763171 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:15.473602 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-9e68d1a1-5bcb-459e-a302-a0a76c763171 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250d6a26720a4416b62f5f7b2c646c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e738363e9f184b01a86d3459779cdfb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:15.481731 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-9e68d1a1-5bcb-459e-a302-a0a76c763171 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] 10.222.0.25 "GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8" status: 200 len: 1555 microversion: 2.1 time: 0.166361 May 10 21:21:15.482310 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 75/174] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:15 2022] GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8 => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:15.627870 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-4ae571ce-3407-47e4-a0c8-3c4a50784b1d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:15.628989 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-4ae571ce-3407-47e4-a0c8-3c4a50784b1d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:15.635323 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4ae571ce-3407-47e4-a0c8-3c4a50784b1d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:15.635769 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4ae571ce-3407-47e4-a0c8-3c4a50784b1d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:15.636590 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4ae571ce-3407-47e4-a0c8-3c4a50784b1d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:15.637013 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4ae571ce-3407-47e4-a0c8-3c4a50784b1d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:15.774027 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-4ae571ce-3407-47e4-a0c8-3c4a50784b1d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:15.782577 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-4ae571ce-3407-47e4-a0c8-3c4a50784b1d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1522 microversion: 2.1 time: 0.158970 May 10 21:21:15.783284 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 100/175] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:15 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:16.499409 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-af37974e-2edf-4769-a7ea-4d5ea9893e95 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:16.500074 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-af37974e-2edf-4769-a7ea-4d5ea9893e95 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] [instance: a840063f-5498-40c6-a89b-053d1db08ef8] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:16.507361 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-af37974e-2edf-4769-a7ea-4d5ea9893e95 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:16.507836 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-af37974e-2edf-4769-a7ea-4d5ea9893e95 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:16.508580 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-af37974e-2edf-4769-a7ea-4d5ea9893e95 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:16.509011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-af37974e-2edf-4769-a7ea-4d5ea9893e95 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:16.644501 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-af37974e-2edf-4769-a7ea-4d5ea9893e95 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250d6a26720a4416b62f5f7b2c646c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e738363e9f184b01a86d3459779cdfb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:16.652706 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-af37974e-2edf-4769-a7ea-4d5ea9893e95 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] 10.222.0.25 "GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8" status: 200 len: 1555 microversion: 2.1 time: 0.157181 May 10 21:21:16.653287 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 76/176] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:16 2022] GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:16.801253 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-e501f053-7bc9-494d-897b-1b0f0069b53d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:16.802504 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-e501f053-7bc9-494d-897b-1b0f0069b53d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:16.808634 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e501f053-7bc9-494d-897b-1b0f0069b53d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:16.809161 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e501f053-7bc9-494d-897b-1b0f0069b53d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:16.810072 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e501f053-7bc9-494d-897b-1b0f0069b53d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:16.810534 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e501f053-7bc9-494d-897b-1b0f0069b53d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:16.942553 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-e501f053-7bc9-494d-897b-1b0f0069b53d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:16.950015 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-e501f053-7bc9-494d-897b-1b0f0069b53d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1522 microversion: 2.1 time: 0.153598 May 10 21:21:16.950656 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 101/177] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:16 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:17.669280 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-c29811ae-1096-405c-b508-5912b14eb6a0 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:17.669885 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-c29811ae-1096-405c-b508-5912b14eb6a0 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] [instance: a840063f-5498-40c6-a89b-053d1db08ef8] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:17.677552 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c29811ae-1096-405c-b508-5912b14eb6a0 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:17.678000 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c29811ae-1096-405c-b508-5912b14eb6a0 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:17.678826 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c29811ae-1096-405c-b508-5912b14eb6a0 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:17.679270 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c29811ae-1096-405c-b508-5912b14eb6a0 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:17.942880 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-c29811ae-1096-405c-b508-5912b14eb6a0 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250d6a26720a4416b62f5f7b2c646c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e738363e9f184b01a86d3459779cdfb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:17.951174 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-c29811ae-1096-405c-b508-5912b14eb6a0 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] 10.222.0.25 "GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8" status: 200 len: 1555 microversion: 2.1 time: 0.285737 May 10 21:21:17.952033 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 77/178] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:17 2022] GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8 => generated 1555 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:17.966680 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-e56dee1d-f58c-4035-a737-868cac47efab tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:17.968995 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-e56dee1d-f58c-4035-a737-868cac47efab tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:17.974247 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e56dee1d-f58c-4035-a737-868cac47efab tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:17.974869 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e56dee1d-f58c-4035-a737-868cac47efab tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:17.975712 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e56dee1d-f58c-4035-a737-868cac47efab tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:17.976151 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e56dee1d-f58c-4035-a737-868cac47efab tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:18.275988 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-e56dee1d-f58c-4035-a737-868cac47efab tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:18.283281 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-e56dee1d-f58c-4035-a737-868cac47efab tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1522 microversion: 2.1 time: 0.320588 May 10 21:21:18.283854 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 102/179] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:17 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1522 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:18.443446 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-6a9a5ba1-ae51-4005-8944-5c674df42873 req-e44e1578-8792-4b6e-a7a6-977b575da2c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a840063f-5498-40c6-a89b-053d1db08ef8", "name": "network-vif-deleted", "tag": "7cc3e14f-fcea-4e69-a7c4-1e231eb42d7c"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:21:18.451262 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-6a9a5ba1-ae51-4005-8944-5c674df42873 req-e44e1578-8792-4b6e-a7a6-977b575da2c8 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:18.451691 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-6a9a5ba1-ae51-4005-8944-5c674df42873 req-e44e1578-8792-4b6e-a7a6-977b575da2c8 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:18.462157 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-6a9a5ba1-ae51-4005-8944-5c674df42873 req-e44e1578-8792-4b6e-a7a6-977b575da2c8 service nova] Creating event network-vif-deleted:7cc3e14f-fcea-4e69-a7c4-1e231eb42d7c for instance a840063f-5498-40c6-a89b-053d1db08ef8 on hv-cinder-83608 May 10 21:21:18.467173 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-6a9a5ba1-ae51-4005-8944-5c674df42873 req-e44e1578-8792-4b6e-a7a6-977b575da2c8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027336 May 10 21:21:18.467746 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 78/180] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:21:18.969537 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-ece96dfd-ca52-4132-81fe-adf78b410559 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:18.970390 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-ece96dfd-ca52-4132-81fe-adf78b410559 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] [instance: a840063f-5498-40c6-a89b-053d1db08ef8] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:18.976614 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ece96dfd-ca52-4132-81fe-adf78b410559 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:18.977080 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ece96dfd-ca52-4132-81fe-adf78b410559 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:18.977866 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ece96dfd-ca52-4132-81fe-adf78b410559 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:18.978295 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ece96dfd-ca52-4132-81fe-adf78b410559 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:19.052978 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-ece96dfd-ca52-4132-81fe-adf78b410559 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250d6a26720a4416b62f5f7b2c646c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e738363e9f184b01a86d3459779cdfb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:19.061466 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-ece96dfd-ca52-4132-81fe-adf78b410559 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] 10.222.0.25 "GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8" status: 200 len: 1346 microversion: 2.1 time: 0.096243 May 10 21:21:19.071458 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 103/181] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:18 2022] GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8 => generated 1346 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:19.301844 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-3dc4d101-656a-41af-8d3c-9b08879b4c4e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:19.305537 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-3dc4d101-656a-41af-8d3c-9b08879b4c4e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:19.309850 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3dc4d101-656a-41af-8d3c-9b08879b4c4e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:19.310296 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3dc4d101-656a-41af-8d3c-9b08879b4c4e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:19.311117 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3dc4d101-656a-41af-8d3c-9b08879b4c4e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:19.311602 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3dc4d101-656a-41af-8d3c-9b08879b4c4e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:19.451253 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-3dc4d101-656a-41af-8d3c-9b08879b4c4e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:19.459821 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-3dc4d101-656a-41af-8d3c-9b08879b4c4e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1522 microversion: 2.1 time: 0.162786 May 10 21:21:19.459906 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 79/182] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:19 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:20.077926 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-1f52807f-4e2b-4183-8847-d0b0cdbf8e6b tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:20.078909 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-1f52807f-4e2b-4183-8847-d0b0cdbf8e6b tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] [instance: a840063f-5498-40c6-a89b-053d1db08ef8] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:20.084889 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1f52807f-4e2b-4183-8847-d0b0cdbf8e6b tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:20.085326 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1f52807f-4e2b-4183-8847-d0b0cdbf8e6b tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:20.086096 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1f52807f-4e2b-4183-8847-d0b0cdbf8e6b tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:20.086621 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1f52807f-4e2b-4183-8847-d0b0cdbf8e6b tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:20.100766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.wsgi [None req-1f52807f-4e2b-4183-8847-d0b0cdbf8e6b tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] HTTP exception thrown: Instance a840063f-5498-40c6-a89b-053d1db08ef8 could not be found. May 10 21:21:20.108990 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-1f52807f-4e2b-4183-8847-d0b0cdbf8e6b tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Request method failure captured: May 10 21:21:20.108990 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: request: GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8 HTTP/1.1 May 10 21:21:20.108990 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept: application/json May 10 21:21:20.108990 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept-Encoding: identity May 10 21:21:20.108990 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Connection: close May 10 21:21:20.108990 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Length: 0 May 10 21:21:20.108990 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Type: application/json May 10 21:21:20.108990 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Host: 10.222.0.25 May 10 21:21:20.108990 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Openstack-System-Scope: None May 10 21:21:20.108990 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: User-Agent: python-urllib3/1.26.9 May 10 21:21:20.108990 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Auth-Token: gAAAAABietcMq4-OxxZmVwTh0nYizLtzUhwC72PbGSs-_zLesIah1spzTsByiCZBQhk6sB28piN0q2GSJGb-PlD4Oyf3vKlZRzCAFDQ48q5Wb_ErXIxkPbg3wXrnju04HyzX6OkjeyIQ5BHrEcRErXG5dPuyHNMdYYKOhK_IwKRngm2wYawn_Mk May 10 21:21:20.108990 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Id: None May 10 21:21:20.108990 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Name: None May 10 21:21:20.108990 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Identity-Status: Confirmed May 10 21:21:20.108990 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Is-Admin-Project: True May 10 21:21:20.108990 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Id: default May 10 21:21:20.108990 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Name: Default May 10 21:21:20.108990 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Id: e738363e9f184b01a86d3459779cdfb4 May 10 21:21:20.108990 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Name: tempest-DeleteServersTestJSON-1546402508 May 10 21:21:20.108990 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Role: member,reader May 10 21:21:20.108990 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Roles: member,reader May 10 21:21:20.110267 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e738363e9f184b01a86d3459779cdfb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e738363e9f184b01a86d3459779cdfb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e738363e9f184b01a86d3459779cdfb4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e738363e9f184b01a86d3459779cdfb4"}]}] May 10 21:21:20.110267 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant: tempest-DeleteServersTestJSON-1546402508 May 10 21:21:20.110267 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Id: e738363e9f184b01a86d3459779cdfb4 May 10 21:21:20.110267 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Name: tempest-DeleteServersTestJSON-1546402508 May 10 21:21:20.110267 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User: tempest-DeleteServersTestJSON-1546402508-project May 10 21:21:20.110267 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Id: default May 10 21:21:20.110267 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Name: Default May 10 21:21:20.110267 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Id: 250d6a26720a4416b62f5f7b2c646c80 May 10 21:21:20.110267 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Name: tempest-DeleteServersTestJSON-1546402508-project May 10 21:21:20.110267 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: method: > May 10 21:21:20.110267 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: exception: Instance a840063f-5498-40c6-a89b-053d1db08ef8 could not be found. May 10 21:21:20.110267 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: action_args: {'id': 'a840063f-5498-40c6-a89b-053d1db08ef8'} May 10 21:21:20.114908 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:21:20.114908 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:21:20.114908 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:21:20.114908 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:21:20.114908 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:21:20.114908 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:21:20.114908 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:21:20.114908 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:21:20.114908 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:21:20.114908 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:21:20.114908 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a840063f-5498-40c6-a89b-053d1db08ef8 could not be found. May 10 21:21:20.114908 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:21:20.114908 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:21:20.114908 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:21:20.114908 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:21:20.114908 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:21:20.114908 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:21:20.114908 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:21:20.114908 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:21:20.114908 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:21:20.116239 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:21:20.116239 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:21:20.116239 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:21:20.116239 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:21:20.116239 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:21:20.116239 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:21:20.116239 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:21:20.116239 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a840063f-5498-40c6-a89b-053d1db08ef8 could not be found. May 10 21:21:20.116239 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:21:20.116239 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:21:20.116239 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:21:20.116239 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:21:20.116239 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:21:20.116239 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:21:20.116239 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:21:20.116239 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:21:20.116239 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a840063f-5498-40c6-a89b-053d1db08ef8 could not be found. May 10 21:21:20.116239 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:21:20.117424 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-1f52807f-4e2b-4183-8847-d0b0cdbf8e6b tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Returning 404 to user: Instance a840063f-5498-40c6-a89b-053d1db08ef8 could not be found. {{(pid=117678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:21:20.117424 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-1f52807f-4e2b-4183-8847-d0b0cdbf8e6b tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] 10.222.0.25 "GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8" status: 404 len: 111 microversion: 2.1 time: 0.036353 May 10 21:21:20.117424 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 104/183] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:20 2022] GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:21:20.468459 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4b14ec22-968c-4371-a786-8c6c572bd520 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:20.469373 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-4b14ec22-968c-4371-a786-8c6c572bd520 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] [instance: a840063f-5498-40c6-a89b-053d1db08ef8] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:20.477136 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-b84fdb72-804f-4fde-b21b-e745ee7f2a1e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:20.477518 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4b14ec22-968c-4371-a786-8c6c572bd520 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:20.477964 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4b14ec22-968c-4371-a786-8c6c572bd520 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:20.478741 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-b84fdb72-804f-4fde-b21b-e745ee7f2a1e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:20.478868 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4b14ec22-968c-4371-a786-8c6c572bd520 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:20.479167 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4b14ec22-968c-4371-a786-8c6c572bd520 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:20.491667 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b84fdb72-804f-4fde-b21b-e745ee7f2a1e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:20.496547 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-4b14ec22-968c-4371-a786-8c6c572bd520 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] HTTP exception thrown: Instance a840063f-5498-40c6-a89b-053d1db08ef8 could not be found. May 10 21:21:20.499112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4b14ec22-968c-4371-a786-8c6c572bd520 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Request method failure captured: May 10 21:21:20.499112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: request: GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8/os-volume_attachments HTTP/1.1 May 10 21:21:20.499112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept: application/json May 10 21:21:20.499112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity May 10 21:21:20.499112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Connection: close May 10 21:21:20.499112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Length: 0 May 10 21:21:20.499112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Type: application/json May 10 21:21:20.499112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Host: 10.222.0.25 May 10 21:21:20.499112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None May 10 21:21:20.499112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 May 10 21:21:20.499112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABietcMq4-OxxZmVwTh0nYizLtzUhwC72PbGSs-_zLesIah1spzTsByiCZBQhk6sB28piN0q2GSJGb-PlD4Oyf3vKlZRzCAFDQ48q5Wb_ErXIxkPbg3wXrnju04HyzX6OkjeyIQ5BHrEcRErXG5dPuyHNMdYYKOhK_IwKRngm2wYawn_Mk May 10 21:21:20.499112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Id: None May 10 21:21:20.499112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Name: None May 10 21:21:20.499112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed May 10 21:21:20.499112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True May 10 21:21:20.499112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default May 10 21:21:20.499112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default May 10 21:21:20.499112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Id: e738363e9f184b01a86d3459779cdfb4 May 10 21:21:20.499112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-DeleteServersTestJSON-1546402508 May 10 21:21:20.499112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Role: member,reader May 10 21:21:20.499112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Roles: member,reader May 10 21:21:20.500709 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e738363e9f184b01a86d3459779cdfb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e738363e9f184b01a86d3459779cdfb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e738363e9f184b01a86d3459779cdfb4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e738363e9f184b01a86d3459779cdfb4"}]}] May 10 21:21:20.500709 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-DeleteServersTestJSON-1546402508 May 10 21:21:20.500709 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Id: e738363e9f184b01a86d3459779cdfb4 May 10 21:21:20.500709 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-DeleteServersTestJSON-1546402508 May 10 21:21:20.500709 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User: tempest-DeleteServersTestJSON-1546402508-project May 10 21:21:20.500709 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default May 10 21:21:20.500709 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default May 10 21:21:20.500709 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Id: 250d6a26720a4416b62f5f7b2c646c80 May 10 21:21:20.500709 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-DeleteServersTestJSON-1546402508-project May 10 21:21:20.500709 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: method: > May 10 21:21:20.500709 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: exception: Instance a840063f-5498-40c6-a89b-053d1db08ef8 could not be found. May 10 21:21:20.500709 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: action_args: {'server_id': 'a840063f-5498-40c6-a89b-053d1db08ef8'} May 10 21:21:20.501480 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:21:20.501480 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:21:20.501480 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:21:20.501480 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:21:20.501480 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:21:20.501480 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:21:20.501480 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:21:20.501480 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:21:20.501480 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:21:20.501480 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:21:20.501480 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a840063f-5498-40c6-a89b-053d1db08ef8 could not be found. May 10 21:21:20.501480 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:21:20.501480 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:21:20.501480 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:21:20.501480 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:21:20.501480 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:21:20.501480 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:21:20.501480 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:21:20.501480 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:21:20.501480 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:21:20.502766 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:21:20.502766 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 21:21:20.502766 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 21:21:20.502766 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 21:21:20.502766 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 21:21:20.502766 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 10 21:21:20.502766 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 10 21:21:20.502766 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:21:20.502766 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:21:20.502766 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a840063f-5498-40c6-a89b-053d1db08ef8 could not be found. May 10 21:21:20.502766 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:21:20.502766 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:21:20.502766 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:21:20.502766 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:21:20.502766 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:21:20.502766 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:21:20.502766 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:21:20.502766 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:21:20.502766 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a840063f-5498-40c6-a89b-053d1db08ef8 could not be found. May 10 21:21:20.502766 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:21:20.505198 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4b14ec22-968c-4371-a786-8c6c572bd520 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Returning 404 to user: Instance a840063f-5498-40c6-a89b-053d1db08ef8 could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:21:20.506052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4b14ec22-968c-4371-a786-8c6c572bd520 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] 10.222.0.25 "GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.041802 May 10 21:21:20.506871 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 80/184] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 10 21:21:20 2022] GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8/os-volume_attachments => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:21:20.507008 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b84fdb72-804f-4fde-b21b-e745ee7f2a1e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:20.508429 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b84fdb72-804f-4fde-b21b-e745ee7f2a1e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:20.509169 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b84fdb72-804f-4fde-b21b-e745ee7f2a1e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:20.655351 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-b84fdb72-804f-4fde-b21b-e745ee7f2a1e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:20.655351 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-b84fdb72-804f-4fde-b21b-e745ee7f2a1e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1522 microversion: 2.1 time: 0.182740 May 10 21:21:20.655894 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 105/185] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:20 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:21.675546 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-3ff697ba-1571-4eec-8795-649bcb1f9bd4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:21.677048 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-3ff697ba-1571-4eec-8795-649bcb1f9bd4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:21.683873 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3ff697ba-1571-4eec-8795-649bcb1f9bd4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:21.684327 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3ff697ba-1571-4eec-8795-649bcb1f9bd4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:21.686414 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3ff697ba-1571-4eec-8795-649bcb1f9bd4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:21.686414 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3ff697ba-1571-4eec-8795-649bcb1f9bd4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:21.830851 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-3ff697ba-1571-4eec-8795-649bcb1f9bd4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:21.846761 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-3ff697ba-1571-4eec-8795-649bcb1f9bd4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1522 microversion: 2.1 time: 0.174840 May 10 21:21:21.847473 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 81/186] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:21 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:21.929949 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-6368b43e-a565-4f39-9b38-063f071782b0 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:21.930390 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-6368b43e-a565-4f39-9b38-063f071782b0 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] [instance: a840063f-5498-40c6-a89b-053d1db08ef8] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:21.936259 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6368b43e-a565-4f39-9b38-063f071782b0 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:21.936894 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6368b43e-a565-4f39-9b38-063f071782b0 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:21.937655 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6368b43e-a565-4f39-9b38-063f071782b0 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:21.938274 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6368b43e-a565-4f39-9b38-063f071782b0 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:21.952835 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.wsgi [None req-6368b43e-a565-4f39-9b38-063f071782b0 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] HTTP exception thrown: Instance a840063f-5498-40c6-a89b-053d1db08ef8 could not be found. May 10 21:21:21.954766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-6368b43e-a565-4f39-9b38-063f071782b0 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Request method failure captured: May 10 21:21:21.954766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: request: DELETE /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8 HTTP/1.1 May 10 21:21:21.954766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept: application/json May 10 21:21:21.954766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept-Encoding: identity May 10 21:21:21.954766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Connection: close May 10 21:21:21.954766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Length: 0 May 10 21:21:21.954766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Type: application/json May 10 21:21:21.954766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Host: 10.222.0.25 May 10 21:21:21.954766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Openstack-System-Scope: None May 10 21:21:21.954766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: User-Agent: python-urllib3/1.26.9 May 10 21:21:21.954766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Auth-Token: gAAAAABietcMq4-OxxZmVwTh0nYizLtzUhwC72PbGSs-_zLesIah1spzTsByiCZBQhk6sB28piN0q2GSJGb-PlD4Oyf3vKlZRzCAFDQ48q5Wb_ErXIxkPbg3wXrnju04HyzX6OkjeyIQ5BHrEcRErXG5dPuyHNMdYYKOhK_IwKRngm2wYawn_Mk May 10 21:21:21.954766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Id: None May 10 21:21:21.954766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Name: None May 10 21:21:21.954766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Identity-Status: Confirmed May 10 21:21:21.954766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Is-Admin-Project: True May 10 21:21:21.954766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Id: default May 10 21:21:21.954766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Name: Default May 10 21:21:21.954766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Id: e738363e9f184b01a86d3459779cdfb4 May 10 21:21:21.954766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Name: tempest-DeleteServersTestJSON-1546402508 May 10 21:21:21.954766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Role: member,reader May 10 21:21:21.954766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Roles: member,reader May 10 21:21:21.955905 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e738363e9f184b01a86d3459779cdfb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e738363e9f184b01a86d3459779cdfb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e738363e9f184b01a86d3459779cdfb4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e738363e9f184b01a86d3459779cdfb4"}]}] May 10 21:21:21.955905 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant: tempest-DeleteServersTestJSON-1546402508 May 10 21:21:21.955905 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Id: e738363e9f184b01a86d3459779cdfb4 May 10 21:21:21.955905 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Name: tempest-DeleteServersTestJSON-1546402508 May 10 21:21:21.955905 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User: tempest-DeleteServersTestJSON-1546402508-project May 10 21:21:21.955905 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Id: default May 10 21:21:21.955905 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Name: Default May 10 21:21:21.955905 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Id: 250d6a26720a4416b62f5f7b2c646c80 May 10 21:21:21.955905 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Name: tempest-DeleteServersTestJSON-1546402508-project May 10 21:21:21.955905 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: method: > May 10 21:21:21.955905 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: exception: Instance a840063f-5498-40c6-a89b-053d1db08ef8 could not be found. May 10 21:21:21.955905 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: action_args: {'id': 'a840063f-5498-40c6-a89b-053d1db08ef8'} May 10 21:21:21.956538 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:21:21.956538 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:21:21.956538 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:21:21.956538 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:21:21.956538 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:21:21.956538 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:21:21.956538 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:21:21.956538 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:21:21.956538 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:21:21.956538 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:21:21.956538 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a840063f-5498-40c6-a89b-053d1db08ef8 could not be found. May 10 21:21:21.956538 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:21:21.956538 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:21:21.956538 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:21:21.956538 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:21:21.956538 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:21:21.956538 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:21:21.956538 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:21:21.956538 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:21:21.956538 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:21:21.957585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:21:21.957585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 21:21:21.957585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 21:21:21.957585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 21:21:21.957585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 21:21:21.957585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:21:21.957585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:21:21.957585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:21:21.957585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:21:21.957585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a840063f-5498-40c6-a89b-053d1db08ef8 could not be found. May 10 21:21:21.957585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:21:21.957585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:21:21.957585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:21:21.957585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:21:21.957585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:21:21.957585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:21:21.957585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:21:21.957585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:21:21.957585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a840063f-5498-40c6-a89b-053d1db08ef8 could not be found. May 10 21:21:21.957585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:21:21.960096 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-6368b43e-a565-4f39-9b38-063f071782b0 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Returning 404 to user: Instance a840063f-5498-40c6-a89b-053d1db08ef8 could not be found. {{(pid=117678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:21:21.960937 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-6368b43e-a565-4f39-9b38-063f071782b0 tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8" status: 404 len: 111 microversion: 2.1 time: 0.035498 May 10 21:21:21.961591 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 106/187] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 10 21:21:21 2022] DELETE /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:21:21.969549 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-226cdad4-1e75-4858-b44d-2feeee71d84d tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:21.970167 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-226cdad4-1e75-4858-b44d-2feeee71d84d tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] [instance: a840063f-5498-40c6-a89b-053d1db08ef8] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:21.976113 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-226cdad4-1e75-4858-b44d-2feeee71d84d tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:21.976564 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-226cdad4-1e75-4858-b44d-2feeee71d84d tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:21.979361 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-226cdad4-1e75-4858-b44d-2feeee71d84d tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:21.979361 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-226cdad4-1e75-4858-b44d-2feeee71d84d tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:21.991163 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-226cdad4-1e75-4858-b44d-2feeee71d84d tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] HTTP exception thrown: Instance a840063f-5498-40c6-a89b-053d1db08ef8 could not be found. May 10 21:21:21.993552 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-226cdad4-1e75-4858-b44d-2feeee71d84d tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Request method failure captured: May 10 21:21:21.993552 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: request: GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8 HTTP/1.1 May 10 21:21:21.993552 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept: application/json May 10 21:21:21.993552 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity May 10 21:21:21.993552 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Connection: close May 10 21:21:21.993552 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Length: 0 May 10 21:21:21.993552 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Type: application/json May 10 21:21:21.993552 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Host: 10.222.0.25 May 10 21:21:21.993552 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None May 10 21:21:21.993552 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 May 10 21:21:21.993552 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABietcMq4-OxxZmVwTh0nYizLtzUhwC72PbGSs-_zLesIah1spzTsByiCZBQhk6sB28piN0q2GSJGb-PlD4Oyf3vKlZRzCAFDQ48q5Wb_ErXIxkPbg3wXrnju04HyzX6OkjeyIQ5BHrEcRErXG5dPuyHNMdYYKOhK_IwKRngm2wYawn_Mk May 10 21:21:21.993552 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Id: None May 10 21:21:21.993552 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Name: None May 10 21:21:21.993552 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed May 10 21:21:21.993552 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True May 10 21:21:21.993552 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default May 10 21:21:21.993552 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default May 10 21:21:21.993552 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Id: e738363e9f184b01a86d3459779cdfb4 May 10 21:21:21.993552 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-DeleteServersTestJSON-1546402508 May 10 21:21:21.993552 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Role: member,reader May 10 21:21:21.993552 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Roles: member,reader May 10 21:21:21.995061 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e738363e9f184b01a86d3459779cdfb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e738363e9f184b01a86d3459779cdfb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e738363e9f184b01a86d3459779cdfb4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e738363e9f184b01a86d3459779cdfb4"}]}] May 10 21:21:21.995061 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-DeleteServersTestJSON-1546402508 May 10 21:21:21.995061 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Id: e738363e9f184b01a86d3459779cdfb4 May 10 21:21:21.995061 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-DeleteServersTestJSON-1546402508 May 10 21:21:21.995061 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User: tempest-DeleteServersTestJSON-1546402508-project May 10 21:21:21.995061 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default May 10 21:21:21.995061 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default May 10 21:21:21.995061 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Id: 250d6a26720a4416b62f5f7b2c646c80 May 10 21:21:21.995061 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-DeleteServersTestJSON-1546402508-project May 10 21:21:21.995061 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: method: > May 10 21:21:21.995061 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: exception: Instance a840063f-5498-40c6-a89b-053d1db08ef8 could not be found. May 10 21:21:21.995061 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: action_args: {'id': 'a840063f-5498-40c6-a89b-053d1db08ef8'} May 10 21:21:21.995864 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:21:21.995864 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:21:21.995864 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:21:21.995864 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:21:21.995864 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:21:21.995864 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:21:21.995864 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:21:21.995864 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:21:21.995864 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:21:21.995864 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:21:21.995864 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a840063f-5498-40c6-a89b-053d1db08ef8 could not be found. May 10 21:21:21.995864 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:21:21.995864 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:21:21.995864 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:21:21.995864 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:21:21.995864 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:21:21.995864 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:21:21.995864 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:21:21.995864 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:21:21.995864 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:21:21.997185 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:21:21.997185 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:21:21.997185 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:21:21.997185 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:21:21.997185 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:21:21.997185 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:21:21.997185 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:21:21.997185 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a840063f-5498-40c6-a89b-053d1db08ef8 could not be found. May 10 21:21:21.997185 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:21:21.997185 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:21:21.997185 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:21:21.997185 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:21:21.997185 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:21:21.997185 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:21:21.997185 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:21:21.997185 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:21:21.997185 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a840063f-5498-40c6-a89b-053d1db08ef8 could not be found. May 10 21:21:21.997185 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:21:21.998373 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-226cdad4-1e75-4858-b44d-2feeee71d84d tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] Returning 404 to user: Instance a840063f-5498-40c6-a89b-053d1db08ef8 could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:21:21.998373 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-226cdad4-1e75-4858-b44d-2feeee71d84d tempest-DeleteServersTestJSON-1546402508 tempest-DeleteServersTestJSON-1546402508-project] 10.222.0.25 "GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8" status: 404 len: 111 microversion: 2.1 time: 0.029397 May 10 21:21:22.002668 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 82/188] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:21 2022] GET /compute/v2.1/servers/a840063f-5498-40c6-a89b-053d1db08ef8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:21:22.868139 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-1b1baef9-c615-41b1-9650-149ed4b8a669 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:22.868992 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-1b1baef9-c615-41b1-9650-149ed4b8a669 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:22.876888 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1b1baef9-c615-41b1-9650-149ed4b8a669 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:22.877336 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1b1baef9-c615-41b1-9650-149ed4b8a669 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:22.878109 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1b1baef9-c615-41b1-9650-149ed4b8a669 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:22.878571 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1b1baef9-c615-41b1-9650-149ed4b8a669 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:23.021244 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-1b1baef9-c615-41b1-9650-149ed4b8a669 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:23.029763 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-1b1baef9-c615-41b1-9650-149ed4b8a669 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1522 microversion: 2.1 time: 0.168248 May 10 21:21:23.030568 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 107/189] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:22 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:24.048902 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-101ada1c-8228-4439-883f-e2331e5ef490 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:24.049511 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-101ada1c-8228-4439-883f-e2331e5ef490 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:24.064009 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-101ada1c-8228-4439-883f-e2331e5ef490 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:24.064441 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-101ada1c-8228-4439-883f-e2331e5ef490 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:24.065210 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-101ada1c-8228-4439-883f-e2331e5ef490 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:24.065633 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-101ada1c-8228-4439-883f-e2331e5ef490 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:24.209738 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-101ada1c-8228-4439-883f-e2331e5ef490 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:24.217100 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-101ada1c-8228-4439-883f-e2331e5ef490 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1522 microversion: 2.1 time: 0.173288 May 10 21:21:24.217661 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 83/190] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:24 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:24.624224 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-fa33e1bb-8ffa-44bf-8131-a589381ee2fb tempest-VolumesGetTestJSON-768666571 tempest-VolumesGetTestJSON-768666571-project] Action: 'create', calling method: .version_select at 0x7f7aea5e6ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1946863375", "metadata": {"Type": "work"}}} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:21:25.234304 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-377bc975-97e1-4784-b76d-8d2f92ebc974 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:25.235017 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-377bc975-97e1-4784-b76d-8d2f92ebc974 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:25.241717 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-377bc975-97e1-4784-b76d-8d2f92ebc974 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:25.242166 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-377bc975-97e1-4784-b76d-8d2f92ebc974 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:25.242964 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-377bc975-97e1-4784-b76d-8d2f92ebc974 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:25.243395 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-377bc975-97e1-4784-b76d-8d2f92ebc974 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:25.406776 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-377bc975-97e1-4784-b76d-8d2f92ebc974 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:25.413367 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-377bc975-97e1-4784-b76d-8d2f92ebc974 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1522 microversion: 2.1 time: 0.182817 May 10 21:21:25.414269 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 84/191] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:25 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:21:25.426335 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-fa33e1bb-8ffa-44bf-8131-a589381ee2fb tempest-VolumesGetTestJSON-768666571 tempest-VolumesGetTestJSON-768666571-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.923974 May 10 21:21:25.427494 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 108/192] 10.222.0.25 () {60 vars in 1155 bytes} [Tue May 10 21:21:24 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 926 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 10 21:21:25.441524 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a23be3dd-a7e4-4327-bab4-32802ee914df tempest-VolumesGetTestJSON-768666571 tempest-VolumesGetTestJSON-768666571-project] Calling method '.version_select at 0x7f7aea628dc0>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:25.493054 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-a23be3dd-a7e4-4327-bab4-32802ee914df tempest-VolumesGetTestJSON-768666571 tempest-VolumesGetTestJSON-768666571-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/ecb86ddb-2898-4223-900d-4419c4aeed5a" status: 200 len: 353 microversion: 2.1 time: 0.055408 May 10 21:21:25.493707 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 85/193] 10.222.0.25 () {58 vars in 1244 bytes} [Tue May 10 21:21:25 2022] GET /compute/v2.1/os-volumes/ecb86ddb-2898-4223-900d-4419c4aeed5a => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:21:26.431113 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-f1ed0e88-8654-4233-8c44-d515035c049b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:26.435659 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-f1ed0e88-8654-4233-8c44-d515035c049b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:26.443075 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f1ed0e88-8654-4233-8c44-d515035c049b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:26.443654 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f1ed0e88-8654-4233-8c44-d515035c049b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:26.445686 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f1ed0e88-8654-4233-8c44-d515035c049b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:26.451425 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f1ed0e88-8654-4233-8c44-d515035c049b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:26.506037 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e98edd6a-3493-4381-afb6-07b5c8563d4a tempest-VolumesGetTestJSON-768666571 tempest-VolumesGetTestJSON-768666571-project] Calling method '.version_select at 0x7f7aea67b5e0>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:26.566668 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-e98edd6a-3493-4381-afb6-07b5c8563d4a tempest-VolumesGetTestJSON-768666571 tempest-VolumesGetTestJSON-768666571-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/ecb86ddb-2898-4223-900d-4419c4aeed5a" status: 200 len: 354 microversion: 2.1 time: 0.064878 May 10 21:21:26.572283 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 86/194] 10.222.0.25 () {58 vars in 1244 bytes} [Tue May 10 21:21:26 2022] GET /compute/v2.1/os-volumes/ecb86ddb-2898-4223-900d-4419c4aeed5a => generated 354 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:21:26.578831 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-d28615cf-465a-4fec-b92b-975615a04046 tempest-VolumesGetTestJSON-768666571 tempest-VolumesGetTestJSON-768666571-project] Calling method '.version_select at 0x7f7aea6763a0>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:26.609310 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-f1ed0e88-8654-4233-8c44-d515035c049b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:26.618785 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-f1ed0e88-8654-4233-8c44-d515035c049b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1522 microversion: 2.1 time: 0.192515 May 10 21:21:26.628328 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 109/195] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:26 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:26.634399 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-d28615cf-465a-4fec-b92b-975615a04046 tempest-VolumesGetTestJSON-768666571 tempest-VolumesGetTestJSON-768666571-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/ecb86ddb-2898-4223-900d-4419c4aeed5a" status: 200 len: 354 microversion: 2.1 time: 0.059426 May 10 21:21:26.635011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 87/196] 10.222.0.25 () {58 vars in 1244 bytes} [Tue May 10 21:21:26 2022] GET /compute/v2.1/os-volumes/ecb86ddb-2898-4223-900d-4419c4aeed5a => generated 354 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:21:26.652369 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-aabca66e-799a-41c2-a020-04613c0a39dc tempest-VolumesGetTestJSON-768666571 tempest-VolumesGetTestJSON-768666571-project] Calling method '.version_select at 0x7f7aea5e6160>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:26.876457 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-aabca66e-799a-41c2-a020-04613c0a39dc tempest-VolumesGetTestJSON-768666571 tempest-VolumesGetTestJSON-768666571-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/ecb86ddb-2898-4223-900d-4419c4aeed5a" status: 202 len: 0 microversion: 2.1 time: 0.223721 May 10 21:21:26.876457 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 110/197] 10.222.0.25 () {58 vars in 1247 bytes} [Tue May 10 21:21:26 2022] DELETE /compute/v2.1/os-volumes/ecb86ddb-2898-4223-900d-4419c4aeed5a => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 21:21:26.878765 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a6d3e269-f182-4a54-a0f4-3a8cf7e073bf tempest-VolumesGetTestJSON-768666571 tempest-VolumesGetTestJSON-768666571-project] Calling method '.version_select at 0x7f7aea798ee0>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:26.931912 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-a6d3e269-f182-4a54-a0f4-3a8cf7e073bf tempest-VolumesGetTestJSON-768666571 tempest-VolumesGetTestJSON-768666571-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/ecb86ddb-2898-4223-900d-4419c4aeed5a" status: 200 len: 353 microversion: 2.1 time: 0.056717 May 10 21:21:26.932995 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 88/198] 10.222.0.25 () {58 vars in 1244 bytes} [Tue May 10 21:21:26 2022] GET /compute/v2.1/os-volumes/ecb86ddb-2898-4223-900d-4419c4aeed5a => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:21:27.636136 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-e634bb3a-14f6-4059-abe0-c2310ea45a4b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:27.636743 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-e634bb3a-14f6-4059-abe0-c2310ea45a4b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:27.642677 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e634bb3a-14f6-4059-abe0-c2310ea45a4b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:27.643313 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e634bb3a-14f6-4059-abe0-c2310ea45a4b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:27.644084 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e634bb3a-14f6-4059-abe0-c2310ea45a4b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:27.644515 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e634bb3a-14f6-4059-abe0-c2310ea45a4b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:27.782643 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-e634bb3a-14f6-4059-abe0-c2310ea45a4b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:27.799036 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-e634bb3a-14f6-4059-abe0-c2310ea45a4b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1522 microversion: 2.1 time: 0.167283 May 10 21:21:27.799632 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 111/199] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:27 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:27.944798 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-c6b31070-3e14-43b4-89bc-1349c4daf1b9 tempest-VolumesGetTestJSON-768666571 tempest-VolumesGetTestJSON-768666571-project] Calling method '.version_select at 0x7f7aea6813a0>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:27.972941 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-c6b31070-3e14-43b4-89bc-1349c4daf1b9 tempest-VolumesGetTestJSON-768666571 tempest-VolumesGetTestJSON-768666571-project] HTTP exception thrown: Volume ecb86ddb-2898-4223-900d-4419c4aeed5a could not be found. May 10 21:21:27.975137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-c6b31070-3e14-43b4-89bc-1349c4daf1b9 tempest-VolumesGetTestJSON-768666571 tempest-VolumesGetTestJSON-768666571-project] Request method failure captured: May 10 21:21:27.975137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: request: GET /compute/v2.1/os-volumes/ecb86ddb-2898-4223-900d-4419c4aeed5a HTTP/1.1 May 10 21:21:27.975137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept: application/json May 10 21:21:27.975137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity May 10 21:21:27.975137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Connection: close May 10 21:21:27.975137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Length: 0 May 10 21:21:27.975137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Type: application/json May 10 21:21:27.975137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Host: 10.222.0.25 May 10 21:21:27.975137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None May 10 21:21:27.975137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 May 10 21:21:27.975137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABietdUIsddiKpXds8OeYNbEhMZAVMUBhYUdTrmDyHOee9hj3h-HvHWrq4AW4q9scGKYBChhKAi8J-tTjNT_b3ZPXo2Ny-Ltqivs9A97Yg4kYcMrkgqUCpQTVp-t1u_M0M_lCLQ7lUO8bmgdwNu_hBelkNYE97_EZMRwRH3JcBqT0YH8b0 May 10 21:21:27.975137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Id: None May 10 21:21:27.975137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Name: None May 10 21:21:27.975137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed May 10 21:21:27.975137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True May 10 21:21:27.975137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default May 10 21:21:27.975137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default May 10 21:21:27.975137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Id: ec32ce28e7cf4bd8b127425ac07a7179 May 10 21:21:27.975137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-VolumesGetTestJSON-768666571 May 10 21:21:27.975137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Role: member,reader May 10 21:21:27.975137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Roles: member,reader May 10 21:21:27.976950 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec32ce28e7cf4bd8b127425ac07a7179"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec32ce28e7cf4bd8b127425ac07a7179"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec32ce28e7cf4bd8b127425ac07a7179"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec32ce28e7cf4bd8b127425ac07a7179"}]}] May 10 21:21:27.976950 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-VolumesGetTestJSON-768666571 May 10 21:21:27.976950 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Id: ec32ce28e7cf4bd8b127425ac07a7179 May 10 21:21:27.976950 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-VolumesGetTestJSON-768666571 May 10 21:21:27.976950 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User: tempest-VolumesGetTestJSON-768666571-project May 10 21:21:27.976950 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default May 10 21:21:27.976950 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default May 10 21:21:27.976950 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Id: 94c2a15d67c24e9187db81d2a6193113 May 10 21:21:27.976950 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-VolumesGetTestJSON-768666571-project May 10 21:21:27.976950 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: method: May 10 21:21:27.976950 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: exception: Volume ecb86ddb-2898-4223-900d-4419c4aeed5a could not be found. May 10 21:21:27.976950 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: action_args: {'id': 'ecb86ddb-2898-4223-900d-4419c4aeed5a'} May 10 21:21:27.976950 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:21:27.977689 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:21:27.977689 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 21:21:27.977689 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 21:21:27.977689 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 21:21:27.977689 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 21:21:27.977689 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 21:21:27.977689 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 21:21:27.977689 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 21:21:27.977689 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 21:21:27.977689 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 21:21:27.977689 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 21:21:27.977689 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:21:27.977689 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:21:27.977689 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:21:27.977689 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:21:27.977689 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ecb86ddb-2898-4223-900d-4419c4aeed5a could not be found. (HTTP 404) (Request-ID: req-7e9570b6-5d0b-4af4-88fb-fd697113ccd4) May 10 21:21:27.977689 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:21:27.977689 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:21:27.977689 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:21:27.984704 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:21:27.984704 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 21:21:27.984704 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 21:21:27.984704 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 21:21:27.984704 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 21:21:27.984704 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 21:21:27.984704 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 21:21:27.984704 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 21:21:27.984704 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 21:21:27.984704 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 21:21:27.984704 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 21:21:27.984704 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 21:21:27.984704 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 21:21:27.984704 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 21:21:27.984704 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 21:21:27.984704 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 21:21:27.984704 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 21:21:27.984704 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 21:21:27.984704 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 21:21:27.985957 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:21:27.985957 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:21:27.985957 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:21:27.985957 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:21:27.985957 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ecb86ddb-2898-4223-900d-4419c4aeed5a could not be found. May 10 21:21:27.985957 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:21:27.985957 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:21:27.985957 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:21:27.985957 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:21:27.985957 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:21:27.985957 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:21:27.985957 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:21:27.985957 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:21:27.985957 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 21:21:27.985957 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 21:21:27.985957 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:21:27.985957 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:21:27.985957 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 21:21:27.985957 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:21:27.987483 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ecb86ddb-2898-4223-900d-4419c4aeed5a could not be found. May 10 21:21:27.987483 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:21:27.987483 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:21:27.987483 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:21:27.987483 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:21:27.987483 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:21:27.987483 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:21:27.987483 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:21:27.987483 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:21:27.987483 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ecb86ddb-2898-4223-900d-4419c4aeed5a could not be found. May 10 21:21:27.987483 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:21:27.987483 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-c6b31070-3e14-43b4-89bc-1349c4daf1b9 tempest-VolumesGetTestJSON-768666571 tempest-VolumesGetTestJSON-768666571-project] Returning 404 to user: Volume ecb86ddb-2898-4223-900d-4419c4aeed5a could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:21:27.987483 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-c6b31070-3e14-43b4-89bc-1349c4daf1b9 tempest-VolumesGetTestJSON-768666571 tempest-VolumesGetTestJSON-768666571-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/ecb86ddb-2898-4223-900d-4419c4aeed5a" status: 404 len: 109 microversion: 2.1 time: 0.040177 May 10 21:21:27.987483 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 89/200] 10.222.0.25 () {58 vars in 1244 bytes} [Tue May 10 21:21:27 2022] GET /compute/v2.1/os-volumes/ecb86ddb-2898-4223-900d-4419c4aeed5a => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:21:28.824379 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-e68e3361-b008-417b-9265-c1c940374afc tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:28.825438 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-e68e3361-b008-417b-9265-c1c940374afc tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:28.837283 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e68e3361-b008-417b-9265-c1c940374afc tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:28.838462 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e68e3361-b008-417b-9265-c1c940374afc tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:28.839757 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e68e3361-b008-417b-9265-c1c940374afc tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:28.840229 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e68e3361-b008-417b-9265-c1c940374afc tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:29.060563 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-e68e3361-b008-417b-9265-c1c940374afc tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:29.068456 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-e68e3361-b008-417b-9265-c1c940374afc tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1522 microversion: 2.1 time: 0.249018 May 10 21:21:29.069115 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 112/201] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:28 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:30.085542 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-b2bff33a-6dd3-450e-adbe-26e301d12acd tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:30.086857 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-b2bff33a-6dd3-450e-adbe-26e301d12acd tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:30.092702 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b2bff33a-6dd3-450e-adbe-26e301d12acd tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:30.093142 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b2bff33a-6dd3-450e-adbe-26e301d12acd tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:30.093896 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b2bff33a-6dd3-450e-adbe-26e301d12acd tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:30.094326 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b2bff33a-6dd3-450e-adbe-26e301d12acd tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:30.228032 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b2bff33a-6dd3-450e-adbe-26e301d12acd tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:30.235398 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-b2bff33a-6dd3-450e-adbe-26e301d12acd tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1522 microversion: 2.1 time: 0.154510 May 10 21:21:30.235964 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 90/202] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:30 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:31.252583 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-61751bf6-3ee3-4e1e-a335-96275cad4ebf tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:31.253210 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-61751bf6-3ee3-4e1e-a335-96275cad4ebf tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:31.259958 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-61751bf6-3ee3-4e1e-a335-96275cad4ebf tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:31.260389 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-61751bf6-3ee3-4e1e-a335-96275cad4ebf tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:31.261138 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-61751bf6-3ee3-4e1e-a335-96275cad4ebf tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:31.261563 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-61751bf6-3ee3-4e1e-a335-96275cad4ebf tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:31.391443 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-61751bf6-3ee3-4e1e-a335-96275cad4ebf tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:31.399284 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-61751bf6-3ee3-4e1e-a335-96275cad4ebf tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1522 microversion: 2.1 time: 0.150728 May 10 21:21:31.399850 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 113/203] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:31 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:32.417028 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-8876dc95-fb43-44a3-8e3b-8a21cfb660a8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:32.417721 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-8876dc95-fb43-44a3-8e3b-8a21cfb660a8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:32.423960 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8876dc95-fb43-44a3-8e3b-8a21cfb660a8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:32.424406 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8876dc95-fb43-44a3-8e3b-8a21cfb660a8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:32.425173 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8876dc95-fb43-44a3-8e3b-8a21cfb660a8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:32.425601 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8876dc95-fb43-44a3-8e3b-8a21cfb660a8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:32.559712 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8876dc95-fb43-44a3-8e3b-8a21cfb660a8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:32.568528 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-8876dc95-fb43-44a3-8e3b-8a21cfb660a8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1522 microversion: 2.1 time: 0.156571 May 10 21:21:32.569108 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 91/204] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:32 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:33.585515 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-2bf5d477-8b5f-4975-abe2-36000cec185b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:33.587102 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-2bf5d477-8b5f-4975-abe2-36000cec185b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:33.592717 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2bf5d477-8b5f-4975-abe2-36000cec185b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:33.596088 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2bf5d477-8b5f-4975-abe2-36000cec185b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:33.596088 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2bf5d477-8b5f-4975-abe2-36000cec185b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:33.596088 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2bf5d477-8b5f-4975-abe2-36000cec185b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:33.730760 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-2bf5d477-8b5f-4975-abe2-36000cec185b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:33.738124 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-2bf5d477-8b5f-4975-abe2-36000cec185b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1522 microversion: 2.1 time: 0.156482 May 10 21:21:33.738722 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 114/205] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:33 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:34.762327 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6e11df46-fd6b-46bf-ab7c-bc28219c856e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:34.764597 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-6e11df46-fd6b-46bf-ab7c-bc28219c856e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:34.771695 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6e11df46-fd6b-46bf-ab7c-bc28219c856e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:34.772140 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6e11df46-fd6b-46bf-ab7c-bc28219c856e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:34.772910 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6e11df46-fd6b-46bf-ab7c-bc28219c856e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:34.774986 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6e11df46-fd6b-46bf-ab7c-bc28219c856e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:34.907764 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-6e11df46-fd6b-46bf-ab7c-bc28219c856e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:34.915197 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-6e11df46-fd6b-46bf-ab7c-bc28219c856e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1522 microversion: 2.1 time: 0.161826 May 10 21:21:34.915775 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 92/206] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:34 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:35.931736 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-82129b0f-b433-4498-a83d-3d45045feaed tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:35.932342 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-82129b0f-b433-4498-a83d-3d45045feaed tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:35.938310 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-82129b0f-b433-4498-a83d-3d45045feaed tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:35.938789 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-82129b0f-b433-4498-a83d-3d45045feaed tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:35.939558 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-82129b0f-b433-4498-a83d-3d45045feaed tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:35.939991 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-82129b0f-b433-4498-a83d-3d45045feaed tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:36.072219 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-82129b0f-b433-4498-a83d-3d45045feaed tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:36.079830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-82129b0f-b433-4498-a83d-3d45045feaed tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1522 microversion: 2.1 time: 0.151888 May 10 21:21:36.080615 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 115/207] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:35 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:37.098754 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-7342be44-92b0-4ed4-8102-49b8f172767d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:37.098754 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-7342be44-92b0-4ed4-8102-49b8f172767d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:37.103818 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7342be44-92b0-4ed4-8102-49b8f172767d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:37.104262 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7342be44-92b0-4ed4-8102-49b8f172767d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:37.105014 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7342be44-92b0-4ed4-8102-49b8f172767d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:37.105514 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7342be44-92b0-4ed4-8102-49b8f172767d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:37.235731 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-7342be44-92b0-4ed4-8102-49b8f172767d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:37.243216 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-7342be44-92b0-4ed4-8102-49b8f172767d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1522 microversion: 2.1 time: 0.150025 May 10 21:21:37.243879 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 93/208] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:37 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:38.260740 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-cb03c1e0-a206-491b-8997-bb73d9e9529b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:38.261259 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-cb03c1e0-a206-491b-8997-bb73d9e9529b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:38.267226 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-cb03c1e0-a206-491b-8997-bb73d9e9529b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:38.267671 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-cb03c1e0-a206-491b-8997-bb73d9e9529b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:38.268437 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-cb03c1e0-a206-491b-8997-bb73d9e9529b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:38.268898 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-cb03c1e0-a206-491b-8997-bb73d9e9529b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:38.396134 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-cb03c1e0-a206-491b-8997-bb73d9e9529b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:38.403822 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-cb03c1e0-a206-491b-8997-bb73d9e9529b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1522 microversion: 2.1 time: 0.147899 May 10 21:21:38.404394 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 116/209] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:38 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:39.420869 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-fe7ced27-56da-46f6-946a-9d51f89b8d27 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:39.420869 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-fe7ced27-56da-46f6-946a-9d51f89b8d27 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:39.427412 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fe7ced27-56da-46f6-946a-9d51f89b8d27 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:39.427863 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fe7ced27-56da-46f6-946a-9d51f89b8d27 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:39.428753 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fe7ced27-56da-46f6-946a-9d51f89b8d27 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:39.429219 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fe7ced27-56da-46f6-946a-9d51f89b8d27 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:39.560924 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-fe7ced27-56da-46f6-946a-9d51f89b8d27 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:39.568348 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-fe7ced27-56da-46f6-946a-9d51f89b8d27 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1522 microversion: 2.1 time: 0.152619 May 10 21:21:39.568924 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 94/210] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:39 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:40.586366 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-613a7417-5367-4c87-911d-3165c485850a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:40.586366 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-613a7417-5367-4c87-911d-3165c485850a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:40.591726 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-613a7417-5367-4c87-911d-3165c485850a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:40.592167 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-613a7417-5367-4c87-911d-3165c485850a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:40.592915 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-613a7417-5367-4c87-911d-3165c485850a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:40.593338 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-613a7417-5367-4c87-911d-3165c485850a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:40.725840 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-613a7417-5367-4c87-911d-3165c485850a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:40.734102 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-613a7417-5367-4c87-911d-3165c485850a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1522 microversion: 2.1 time: 0.153069 May 10 21:21:40.734844 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 117/211] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:40 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:41.753454 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-1f054c2a-7361-47e1-b273-34a4120cab6b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:41.753454 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-1f054c2a-7361-47e1-b273-34a4120cab6b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:41.759952 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1f054c2a-7361-47e1-b273-34a4120cab6b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:41.760434 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1f054c2a-7361-47e1-b273-34a4120cab6b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:41.761202 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1f054c2a-7361-47e1-b273-34a4120cab6b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:41.761638 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1f054c2a-7361-47e1-b273-34a4120cab6b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:41.894511 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1f054c2a-7361-47e1-b273-34a4120cab6b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:41.902891 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-1f054c2a-7361-47e1-b273-34a4120cab6b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1522 microversion: 2.1 time: 0.154398 May 10 21:21:41.903453 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 95/212] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:41 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:42.919692 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-a40b8c66-6759-4b3d-864f-bceecb7eb91a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:42.920282 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-a40b8c66-6759-4b3d-864f-bceecb7eb91a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:42.926130 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-a40b8c66-6759-4b3d-864f-bceecb7eb91a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:42.926637 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-a40b8c66-6759-4b3d-864f-bceecb7eb91a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:42.927389 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-a40b8c66-6759-4b3d-864f-bceecb7eb91a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:42.927817 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-a40b8c66-6759-4b3d-864f-bceecb7eb91a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:43.062062 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-a40b8c66-6759-4b3d-864f-bceecb7eb91a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:43.069500 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-a40b8c66-6759-4b3d-864f-bceecb7eb91a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1522 microversion: 2.1 time: 0.153677 May 10 21:21:43.070109 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 118/213] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:42 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:44.086371 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-48222f2a-bc20-44e5-8d2a-3b057a3ac80a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:44.087034 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-48222f2a-bc20-44e5-8d2a-3b057a3ac80a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:44.093360 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-48222f2a-bc20-44e5-8d2a-3b057a3ac80a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:44.093809 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-48222f2a-bc20-44e5-8d2a-3b057a3ac80a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:44.094604 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-48222f2a-bc20-44e5-8d2a-3b057a3ac80a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:44.095037 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-48222f2a-bc20-44e5-8d2a-3b057a3ac80a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:44.225631 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-48222f2a-bc20-44e5-8d2a-3b057a3ac80a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:44.233109 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-48222f2a-bc20-44e5-8d2a-3b057a3ac80a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1522 microversion: 2.1 time: 0.151133 May 10 21:21:44.233689 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 96/214] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:44 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:45.250534 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-390824f5-006f-4743-80ef-de33f5d178e4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:45.251135 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-390824f5-006f-4743-80ef-de33f5d178e4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:45.257072 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-390824f5-006f-4743-80ef-de33f5d178e4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:45.258086 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-390824f5-006f-4743-80ef-de33f5d178e4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:45.258881 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-390824f5-006f-4743-80ef-de33f5d178e4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:45.259316 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-390824f5-006f-4743-80ef-de33f5d178e4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:45.382492 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-390824f5-006f-4743-80ef-de33f5d178e4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:45.390317 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-390824f5-006f-4743-80ef-de33f5d178e4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1522 microversion: 2.1 time: 0.143685 May 10 21:21:45.390920 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 119/215] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:45 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:46.406855 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-c7c018cb-953c-4682-8e6f-9ddf71195638 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:46.407457 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-c7c018cb-953c-4682-8e6f-9ddf71195638 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:46.414348 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c7c018cb-953c-4682-8e6f-9ddf71195638 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:46.414821 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c7c018cb-953c-4682-8e6f-9ddf71195638 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:46.415610 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c7c018cb-953c-4682-8e6f-9ddf71195638 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:46.416031 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c7c018cb-953c-4682-8e6f-9ddf71195638 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:46.545736 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-c7c018cb-953c-4682-8e6f-9ddf71195638 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:46.553014 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-c7c018cb-953c-4682-8e6f-9ddf71195638 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1522 microversion: 2.1 time: 0.149982 May 10 21:21:46.553590 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 97/216] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:46 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:47.569988 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-906e2cc5-7d98-4626-8fdb-7c91dcdd4ab7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:47.570832 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-906e2cc5-7d98-4626-8fdb-7c91dcdd4ab7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:47.576631 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-906e2cc5-7d98-4626-8fdb-7c91dcdd4ab7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:47.577086 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-906e2cc5-7d98-4626-8fdb-7c91dcdd4ab7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:47.577861 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-906e2cc5-7d98-4626-8fdb-7c91dcdd4ab7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:47.578297 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-906e2cc5-7d98-4626-8fdb-7c91dcdd4ab7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:47.706756 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-906e2cc5-7d98-4626-8fdb-7c91dcdd4ab7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:47.715235 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-906e2cc5-7d98-4626-8fdb-7c91dcdd4ab7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1522 microversion: 2.1 time: 0.149632 May 10 21:21:47.715826 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 120/217] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:47 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:48.732700 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-055d0a83-4737-4e29-9bda-5a1b94527356 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:48.733301 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-055d0a83-4737-4e29-9bda-5a1b94527356 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:48.739502 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-055d0a83-4737-4e29-9bda-5a1b94527356 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:48.739938 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-055d0a83-4737-4e29-9bda-5a1b94527356 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:48.743443 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-055d0a83-4737-4e29-9bda-5a1b94527356 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:48.743443 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-055d0a83-4737-4e29-9bda-5a1b94527356 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:48.877438 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-055d0a83-4737-4e29-9bda-5a1b94527356 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:48.885386 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-055d0a83-4737-4e29-9bda-5a1b94527356 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1522 microversion: 2.1 time: 0.156694 May 10 21:21:48.885956 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 98/218] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:48 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:49.903051 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-24ebbac1-5d46-4aef-bbd7-6559ac637c6b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:49.906885 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-24ebbac1-5d46-4aef-bbd7-6559ac637c6b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:49.909545 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-24ebbac1-5d46-4aef-bbd7-6559ac637c6b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:49.909985 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-24ebbac1-5d46-4aef-bbd7-6559ac637c6b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:49.910779 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-24ebbac1-5d46-4aef-bbd7-6559ac637c6b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:49.911251 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-24ebbac1-5d46-4aef-bbd7-6559ac637c6b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:50.064398 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-24ebbac1-5d46-4aef-bbd7-6559ac637c6b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:50.072626 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-24ebbac1-5d46-4aef-bbd7-6559ac637c6b tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1522 microversion: 2.1 time: 0.174087 May 10 21:21:50.073400 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 121/219] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:49 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:21:51.090332 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-39dfedca-a078-4e61-9d3d-eaa6322a63f5 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:51.091002 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-39dfedca-a078-4e61-9d3d-eaa6322a63f5 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:51.097084 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-39dfedca-a078-4e61-9d3d-eaa6322a63f5 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:51.097566 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-39dfedca-a078-4e61-9d3d-eaa6322a63f5 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:51.098276 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-39dfedca-a078-4e61-9d3d-eaa6322a63f5 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:51.098725 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-39dfedca-a078-4e61-9d3d-eaa6322a63f5 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:51.257688 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-39dfedca-a078-4e61-9d3d-eaa6322a63f5 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:51.265083 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-39dfedca-a078-4e61-9d3d-eaa6322a63f5 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1522 microversion: 2.1 time: 0.178653 May 10 21:21:51.266402 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 99/220] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:51 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:52.281416 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-6855a446-e6fd-4748-883b-5eba297ad907 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:52.282030 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-6855a446-e6fd-4748-883b-5eba297ad907 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:52.288108 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6855a446-e6fd-4748-883b-5eba297ad907 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:52.288557 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6855a446-e6fd-4748-883b-5eba297ad907 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:52.289508 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6855a446-e6fd-4748-883b-5eba297ad907 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:52.289939 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6855a446-e6fd-4748-883b-5eba297ad907 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:52.424510 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-6855a446-e6fd-4748-883b-5eba297ad907 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:52.432478 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-6855a446-e6fd-4748-883b-5eba297ad907 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1502 microversion: 2.1 time: 0.154896 May 10 21:21:52.433064 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 122/221] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:52 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:52.451495 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-488cf05c-d541-4aba-a58b-1c33f0f6cdc3 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:52.452186 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-488cf05c-d541-4aba-a58b-1c33f0f6cdc3 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:52.458190 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-488cf05c-d541-4aba-a58b-1c33f0f6cdc3 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:52.459318 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-488cf05c-d541-4aba-a58b-1c33f0f6cdc3 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:52.460105 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-488cf05c-d541-4aba-a58b-1c33f0f6cdc3 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:52.460532 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-488cf05c-d541-4aba-a58b-1c33f0f6cdc3 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:52.591749 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-488cf05c-d541-4aba-a58b-1c33f0f6cdc3 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:52.599135 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-488cf05c-d541-4aba-a58b-1c33f0f6cdc3 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad" status: 200 len: 1516 microversion: 2.1 time: 0.153035 May 10 21:21:52.599705 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 100/222] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:52 2022] GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:55.431118 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-386a7c4d-1e33-4080-b5b1-ca73181a4917 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:21:55.432507 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-386a7c4d-1e33-4080-b5b1-ca73181a4917 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:55.438394 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-386a7c4d-1e33-4080-b5b1-ca73181a4917 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:55.438875 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-386a7c4d-1e33-4080-b5b1-ca73181a4917 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:55.439654 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-386a7c4d-1e33-4080-b5b1-ca73181a4917 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:55.440084 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-386a7c4d-1e33-4080-b5b1-ca73181a4917 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:55.463637 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.objects.instance [None req-386a7c4d-1e33-4080-b5b1-ca73181a4917 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lazy-loading 'flavor' on Instance uuid e4ec9c2a-8806-4da8-9072-ca136cfa83ad {{(pid=117678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:21:55.711917 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-386a7c4d-1e33-4080-b5b1-ca73181a4917 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "POST /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad/action" status: 200 len: 32 microversion: 2.1 time: 0.285435 May 10 21:21:55.712598 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 123/223] 10.222.0.25 () {60 vars in 1277 bytes} [Tue May 10 21:21:55 2022] POST /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad/action => generated 32 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 21:21:55.721658 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-9c86a919-c6a8-4578-8daa-573e9d7a342e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:55.722354 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-9c86a919-c6a8-4578-8daa-573e9d7a342e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:55.729787 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9c86a919-c6a8-4578-8daa-573e9d7a342e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:55.730361 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9c86a919-c6a8-4578-8daa-573e9d7a342e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:55.732415 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9c86a919-c6a8-4578-8daa-573e9d7a342e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:55.732415 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9c86a919-c6a8-4578-8daa-573e9d7a342e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:55.860457 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-9c86a919-c6a8-4578-8daa-573e9d7a342e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:55.868986 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-9c86a919-c6a8-4578-8daa-573e9d7a342e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad" status: 200 len: 1522 microversion: 2.1 time: 0.150349 May 10 21:21:55.869538 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 101/224] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:55 2022] GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:56.887029 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-38e3f384-c577-4055-9f86-2310bcc2e3fe tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:56.887723 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-38e3f384-c577-4055-9f86-2310bcc2e3fe tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:56.893894 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-38e3f384-c577-4055-9f86-2310bcc2e3fe tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:56.894340 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-38e3f384-c577-4055-9f86-2310bcc2e3fe tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:56.895132 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-38e3f384-c577-4055-9f86-2310bcc2e3fe tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:56.895568 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-38e3f384-c577-4055-9f86-2310bcc2e3fe tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:57.022386 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-38e3f384-c577-4055-9f86-2310bcc2e3fe tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:57.030734 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-38e3f384-c577-4055-9f86-2310bcc2e3fe tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad" status: 200 len: 1522 microversion: 2.1 time: 0.148381 May 10 21:21:57.031317 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 124/225] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:56 2022] GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:58.048637 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-5207bd42-9a2a-46a5-adc8-08d363b7c120 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:58.049249 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-5207bd42-9a2a-46a5-adc8-08d363b7c120 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:58.055562 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5207bd42-9a2a-46a5-adc8-08d363b7c120 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:58.056007 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5207bd42-9a2a-46a5-adc8-08d363b7c120 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:58.056762 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5207bd42-9a2a-46a5-adc8-08d363b7c120 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:58.058151 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5207bd42-9a2a-46a5-adc8-08d363b7c120 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:58.187646 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-5207bd42-9a2a-46a5-adc8-08d363b7c120 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:58.194978 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-5207bd42-9a2a-46a5-adc8-08d363b7c120 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad" status: 200 len: 1522 microversion: 2.1 time: 0.150210 May 10 21:21:58.195540 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 102/226] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:58 2022] GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:59.212228 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-ecb2138c-540d-47e9-9317-4c9e212732ec tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:59.212825 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-ecb2138c-540d-47e9-9317-4c9e212732ec tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:59.218997 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ecb2138c-540d-47e9-9317-4c9e212732ec tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:59.219437 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ecb2138c-540d-47e9-9317-4c9e212732ec tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:59.220214 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ecb2138c-540d-47e9-9317-4c9e212732ec tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:59.220644 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ecb2138c-540d-47e9-9317-4c9e212732ec tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:59.347796 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-ecb2138c-540d-47e9-9317-4c9e212732ec tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:59.355185 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-ecb2138c-540d-47e9-9317-4c9e212732ec tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad" status: 200 len: 1522 microversion: 2.1 time: 0.146840 May 10 21:21:59.355750 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 125/227] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:21:59 2022] GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:00.372546 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-2536d07c-e79e-425a-a303-5b1636f0a977 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:00.373119 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-2536d07c-e79e-425a-a303-5b1636f0a977 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:00.379515 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2536d07c-e79e-425a-a303-5b1636f0a977 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:00.379965 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2536d07c-e79e-425a-a303-5b1636f0a977 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:00.380735 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2536d07c-e79e-425a-a303-5b1636f0a977 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:00.381165 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2536d07c-e79e-425a-a303-5b1636f0a977 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:00.511628 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2536d07c-e79e-425a-a303-5b1636f0a977 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:00.520166 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-2536d07c-e79e-425a-a303-5b1636f0a977 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad" status: 200 len: 1522 microversion: 2.1 time: 0.151484 May 10 21:22:00.520747 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 103/228] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:00 2022] GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:01.538889 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-89c9eb7d-bab3-41f3-bbc3-5e89668516a7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:01.539486 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-89c9eb7d-bab3-41f3-bbc3-5e89668516a7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:01.546031 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-89c9eb7d-bab3-41f3-bbc3-5e89668516a7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:01.546497 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-89c9eb7d-bab3-41f3-bbc3-5e89668516a7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:01.547278 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-89c9eb7d-bab3-41f3-bbc3-5e89668516a7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:01.547698 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-89c9eb7d-bab3-41f3-bbc3-5e89668516a7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:01.675845 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-89c9eb7d-bab3-41f3-bbc3-5e89668516a7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:01.683048 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-89c9eb7d-bab3-41f3-bbc3-5e89668516a7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad" status: 200 len: 1522 microversion: 2.1 time: 0.148278 May 10 21:22:01.683612 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 126/229] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:01 2022] GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:22:02.699493 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-cd6adbdc-2169-44d6-a60c-5866660b7bf8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:02.700137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-cd6adbdc-2169-44d6-a60c-5866660b7bf8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:02.706564 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cd6adbdc-2169-44d6-a60c-5866660b7bf8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:02.707014 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cd6adbdc-2169-44d6-a60c-5866660b7bf8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:02.707773 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cd6adbdc-2169-44d6-a60c-5866660b7bf8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:02.708207 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cd6adbdc-2169-44d6-a60c-5866660b7bf8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:02.832019 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-cd6adbdc-2169-44d6-a60c-5866660b7bf8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:02.839333 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-cd6adbdc-2169-44d6-a60c-5866660b7bf8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad" status: 200 len: 1522 microversion: 2.1 time: 0.143622 May 10 21:22:02.839935 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 104/230] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:02 2022] GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:03.855901 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-bbd33ba9-87c7-44a1-a4e8-55402fbf3d78 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:03.857274 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-bbd33ba9-87c7-44a1-a4e8-55402fbf3d78 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:03.863916 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-bbd33ba9-87c7-44a1-a4e8-55402fbf3d78 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:03.864452 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-bbd33ba9-87c7-44a1-a4e8-55402fbf3d78 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:03.865293 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-bbd33ba9-87c7-44a1-a4e8-55402fbf3d78 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:03.865761 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-bbd33ba9-87c7-44a1-a4e8-55402fbf3d78 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:03.991209 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-bbd33ba9-87c7-44a1-a4e8-55402fbf3d78 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:03.999240 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-bbd33ba9-87c7-44a1-a4e8-55402fbf3d78 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad" status: 200 len: 1522 microversion: 2.1 time: 0.147202 May 10 21:22:03.999815 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 127/231] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:03 2022] GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:05.016399 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-c7cad585-b53c-442c-84d0-0bfcc354d965 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:05.017012 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-c7cad585-b53c-442c-84d0-0bfcc354d965 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:05.023264 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c7cad585-b53c-442c-84d0-0bfcc354d965 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:05.023710 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c7cad585-b53c-442c-84d0-0bfcc354d965 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:05.024468 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c7cad585-b53c-442c-84d0-0bfcc354d965 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:05.024896 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c7cad585-b53c-442c-84d0-0bfcc354d965 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:05.154849 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-c7cad585-b53c-442c-84d0-0bfcc354d965 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:05.162351 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-c7cad585-b53c-442c-84d0-0bfcc354d965 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad" status: 200 len: 1522 microversion: 2.1 time: 0.149709 May 10 21:22:05.162970 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 105/232] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:05 2022] GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:06.185698 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-942bd6d8-8724-4bd6-b0f9-d99131e544d4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:06.186389 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-942bd6d8-8724-4bd6-b0f9-d99131e544d4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:06.192150 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-942bd6d8-8724-4bd6-b0f9-d99131e544d4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:06.192587 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-942bd6d8-8724-4bd6-b0f9-d99131e544d4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:06.193335 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-942bd6d8-8724-4bd6-b0f9-d99131e544d4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:06.193761 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-942bd6d8-8724-4bd6-b0f9-d99131e544d4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:06.318396 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-942bd6d8-8724-4bd6-b0f9-d99131e544d4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:06.325754 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-942bd6d8-8724-4bd6-b0f9-d99131e544d4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad" status: 200 len: 1522 microversion: 2.1 time: 0.144562 May 10 21:22:06.326329 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 128/233] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:06 2022] GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:07.342063 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-95e481d1-e50f-49d7-a1e7-261b254cf1d2 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:07.342716 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-95e481d1-e50f-49d7-a1e7-261b254cf1d2 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:07.349073 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-95e481d1-e50f-49d7-a1e7-261b254cf1d2 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:07.349510 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-95e481d1-e50f-49d7-a1e7-261b254cf1d2 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:07.350306 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-95e481d1-e50f-49d7-a1e7-261b254cf1d2 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:07.350752 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-95e481d1-e50f-49d7-a1e7-261b254cf1d2 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:07.477034 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-95e481d1-e50f-49d7-a1e7-261b254cf1d2 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:07.485144 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-95e481d1-e50f-49d7-a1e7-261b254cf1d2 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad" status: 200 len: 1522 microversion: 2.1 time: 0.147100 May 10 21:22:07.485718 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 106/234] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:07 2022] GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:08.502154 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-35274f55-8c1f-4298-a90a-fd24488b46db tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:08.502787 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-35274f55-8c1f-4298-a90a-fd24488b46db tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:08.509109 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-35274f55-8c1f-4298-a90a-fd24488b46db tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:08.509554 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-35274f55-8c1f-4298-a90a-fd24488b46db tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:08.510317 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-35274f55-8c1f-4298-a90a-fd24488b46db tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:08.510790 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-35274f55-8c1f-4298-a90a-fd24488b46db tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:08.636944 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-35274f55-8c1f-4298-a90a-fd24488b46db tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:08.644742 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-35274f55-8c1f-4298-a90a-fd24488b46db tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad" status: 200 len: 1522 microversion: 2.1 time: 0.146431 May 10 21:22:08.645317 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 129/235] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:08 2022] GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:09.038823 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-b2547297-7ce8-41cc-be6d-014a8762e6a9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:09.039323 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-b2547297-7ce8-41cc-be6d-014a8762e6a9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:09.046174 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b2547297-7ce8-41cc-be6d-014a8762e6a9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:09.046652 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b2547297-7ce8-41cc-be6d-014a8762e6a9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:09.047405 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b2547297-7ce8-41cc-be6d-014a8762e6a9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:09.047826 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b2547297-7ce8-41cc-be6d-014a8762e6a9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:09.071042 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-b2547297-7ce8-41cc-be6d-014a8762e6a9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869/ips" status: 200 len: 151 microversion: 2.20 time: 0.036229 May 10 21:22:09.071591 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 107/236] 10.222.0.25 () {60 vars in 1288 bytes} [Tue May 10 21:22:09 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:22:09.661917 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-bdaace3d-3143-485c-bf3a-74623bc08cef tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:09.662559 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-bdaace3d-3143-485c-bf3a-74623bc08cef tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:09.668576 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-bdaace3d-3143-485c-bf3a-74623bc08cef tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:09.670329 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-bdaace3d-3143-485c-bf3a-74623bc08cef tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:09.676596 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-bdaace3d-3143-485c-bf3a-74623bc08cef tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:09.676596 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-bdaace3d-3143-485c-bf3a-74623bc08cef tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:09.802130 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-bdaace3d-3143-485c-bf3a-74623bc08cef tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:09.809370 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-bdaace3d-3143-485c-bf3a-74623bc08cef tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad" status: 200 len: 1522 microversion: 2.1 time: 0.151278 May 10 21:22:09.809949 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 130/237] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:09 2022] GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:10.826062 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a3de7195-05e7-4b5a-b4ed-b7be895fefd1 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:10.826625 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-a3de7195-05e7-4b5a-b4ed-b7be895fefd1 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:10.832960 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a3de7195-05e7-4b5a-b4ed-b7be895fefd1 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:10.833408 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a3de7195-05e7-4b5a-b4ed-b7be895fefd1 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:10.834167 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a3de7195-05e7-4b5a-b4ed-b7be895fefd1 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:10.834646 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a3de7195-05e7-4b5a-b4ed-b7be895fefd1 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:10.959225 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-a3de7195-05e7-4b5a-b4ed-b7be895fefd1 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:10.966886 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-a3de7195-05e7-4b5a-b4ed-b7be895fefd1 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad" status: 200 len: 1522 microversion: 2.1 time: 0.145104 May 10 21:22:10.967449 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 108/238] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:10 2022] GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:11.759753 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-426e4976-6a35-40cb-888c-7d92c74f65e0 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1685399461", "imageRef": "2d72b3e0-7d02-481e-b5e6-17f44e8729d6", "flavorRef": "452"}} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:22:11.811843 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.network.neutron [None req-426e4976-6a35-40cb-888c-7d92c74f65e0 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] validate_networks() for None {{(pid=117678) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 21:22:11.985529 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4ff75d84-334c-4bca-8112-45299e4dfefb tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:11.986529 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-4ff75d84-334c-4bca-8112-45299e4dfefb tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:11.993687 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4ff75d84-334c-4bca-8112-45299e4dfefb tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:11.995677 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4ff75d84-334c-4bca-8112-45299e4dfefb tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:11.996476 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4ff75d84-334c-4bca-8112-45299e4dfefb tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:11.996918 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4ff75d84-334c-4bca-8112-45299e4dfefb tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:12.095790 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-426e4976-6a35-40cb-888c-7d92c74f65e0 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Flavor limits 0:0:0 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 21:22:12.096624 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-426e4976-6a35-40cb-888c-7d92c74f65e0 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Image limits 0:0:0 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 21:22:12.097109 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-426e4976-6a35-40cb-888c-7d92c74f65e0 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Flavor pref 0:0:0 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 21:22:12.097668 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-426e4976-6a35-40cb-888c-7d92c74f65e0 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Image pref 0:0:0 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 21:22:12.098252 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-426e4976-6a35-40cb-888c-7d92c74f65e0 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 21:22:12.108977 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-426e4976-6a35-40cb-888c-7d92c74f65e0 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:12.109422 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-426e4976-6a35-40cb-888c-7d92c74f65e0 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:12.110625 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-426e4976-6a35-40cb-888c-7d92c74f65e0 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:12.111133 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-426e4976-6a35-40cb-888c-7d92c74f65e0 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:12.129830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.quota [None req-426e4976-6a35-40cb-888c-7d92c74f65e0 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Getting quotas for project eda2d177aafc4fea94a790441a580fcf. Resources: {'cores', 'instances', 'ram'} {{(pid=117678) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:22:12.134307 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.quota [None req-426e4976-6a35-40cb-888c-7d92c74f65e0 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Getting quotas for user 84dc62e15dfc4212bd91e0946e89dd9d and project eda2d177aafc4fea94a790441a580fcf. Resources: {'cores', 'instances', 'ram'} {{(pid=117678) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:22:12.143038 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-4ff75d84-334c-4bca-8112-45299e4dfefb tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:12.149792 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-426e4976-6a35-40cb-888c-7d92c74f65e0 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Going to run 1 instances... {{(pid=117678) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 21:22:12.151113 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4ff75d84-334c-4bca-8112-45299e4dfefb tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad" status: 200 len: 1522 microversion: 2.1 time: 0.170629 May 10 21:22:12.151945 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 109/239] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:11 2022] GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:12.152088 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-426e4976-6a35-40cb-888c-7d92c74f65e0 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] [instance: 82497d59-5b76-4042-bd16-d88afa339f48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d72b3e0-7d02-481e-b5e6-17f44e8729d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 21:22:12.302905 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-426e4976-6a35-40cb-888c-7d92c74f65e0 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.547274 May 10 21:22:12.303561 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 131/240] 10.222.0.25 () {60 vars in 1146 bytes} [Tue May 10 21:22:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 21:22:12.314157 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-ec010339-b7b3-4adc-b403-b3c9ab2ba0ab tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:12.314861 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-ec010339-b7b3-4adc-b403-b3c9ab2ba0ab tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] [instance: 82497d59-5b76-4042-bd16-d88afa339f48] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:12.366641 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-ec010339-b7b3-4adc-b403-b3c9ab2ba0ab tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dc62e15dfc4212bd91e0946e89dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda2d177aafc4fea94a790441a580fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:12.373797 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-ec010339-b7b3-4adc-b403-b3c9ab2ba0ab tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] 10.222.0.25 "GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48" status: 200 len: 1215 microversion: 2.1 time: 0.064225 May 10 21:22:12.374366 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 110/241] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:12 2022] GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48 => generated 1215 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:13.169307 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-c6482afc-5245-43b6-8915-7ef05d1b24a3 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:13.169917 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-c6482afc-5245-43b6-8915-7ef05d1b24a3 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:13.176302 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c6482afc-5245-43b6-8915-7ef05d1b24a3 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:13.176743 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c6482afc-5245-43b6-8915-7ef05d1b24a3 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:13.177539 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c6482afc-5245-43b6-8915-7ef05d1b24a3 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:13.177968 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c6482afc-5245-43b6-8915-7ef05d1b24a3 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:13.334189 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-c6482afc-5245-43b6-8915-7ef05d1b24a3 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:13.341823 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-c6482afc-5245-43b6-8915-7ef05d1b24a3 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad" status: 200 len: 1522 microversion: 2.1 time: 0.176541 May 10 21:22:13.342745 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 132/242] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:13 2022] GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:13.391808 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-0a365b65-4e4f-4f01-a2b0-90196852421b tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:13.392405 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-0a365b65-4e4f-4f01-a2b0-90196852421b tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] [instance: 82497d59-5b76-4042-bd16-d88afa339f48] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:13.399183 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0a365b65-4e4f-4f01-a2b0-90196852421b tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:13.399619 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0a365b65-4e4f-4f01-a2b0-90196852421b tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:13.400376 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0a365b65-4e4f-4f01-a2b0-90196852421b tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:13.400851 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0a365b65-4e4f-4f01-a2b0-90196852421b tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:13.457958 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-1e00e029-d8c0-4e43-818d-28115e569aa8 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:22:13.458942 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-1e00e029-d8c0-4e43-818d-28115e569aa8 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:13.465814 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1e00e029-d8c0-4e43-818d-28115e569aa8 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:13.466537 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1e00e029-d8c0-4e43-818d-28115e569aa8 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:13.467306 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1e00e029-d8c0-4e43-818d-28115e569aa8 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:13.467894 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1e00e029-d8c0-4e43-818d-28115e569aa8 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:13.481805 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-0a365b65-4e4f-4f01-a2b0-90196852421b tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dc62e15dfc4212bd91e0946e89dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda2d177aafc4fea94a790441a580fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:13.490456 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-0a365b65-4e4f-4f01-a2b0-90196852421b tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] 10.222.0.25 "GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48" status: 200 len: 1219 microversion: 2.1 time: 0.103047 May 10 21:22:13.493373 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 111/243] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:13 2022] GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48 => generated 1219 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:13.502982 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.objects.instance [None req-1e00e029-d8c0-4e43-818d-28115e569aa8 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lazy-loading 'flavor' on Instance uuid ef19cfc2-aeb2-40ff-b25c-187304690869 {{(pid=117678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:22:14.032668 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-1e00e029-d8c0-4e43-818d-28115e569aa8 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "POST /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869/action" status: 202 len: 0 microversion: 2.20 time: 0.578907 May 10 21:22:14.033293 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 133/244] 10.222.0.25 () {62 vars in 1318 bytes} [Tue May 10 21:22:13 2022] POST /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869/action => generated 0 bytes in 581 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 21:22:14.041476 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6d8ebfe1-54a6-4623-be5c-e5d1552b894a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:14.042071 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-6d8ebfe1-54a6-4623-be5c-e5d1552b894a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:14.048757 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6d8ebfe1-54a6-4623-be5c-e5d1552b894a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:14.049190 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6d8ebfe1-54a6-4623-be5c-e5d1552b894a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:14.049935 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6d8ebfe1-54a6-4623-be5c-e5d1552b894a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:14.050359 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6d8ebfe1-54a6-4623-be5c-e5d1552b894a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:14.174780 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-6d8ebfe1-54a6-4623-be5c-e5d1552b894a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:14.182512 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-6d8ebfe1-54a6-4623-be5c-e5d1552b894a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:14.183999 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-6d8ebfe1-54a6-4623-be5c-e5d1552b894a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:14.185127 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-6d8ebfe1-54a6-4623-be5c-e5d1552b894a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1723 microversion: 2.20 time: 0.147508 May 10 21:22:14.185858 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 112/245] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:22:14 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:22:14.358805 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-c0fab825-6f7c-4875-917d-ebd2c6345e2c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:14.359678 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-c0fab825-6f7c-4875-917d-ebd2c6345e2c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:14.365948 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c0fab825-6f7c-4875-917d-ebd2c6345e2c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:14.366387 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c0fab825-6f7c-4875-917d-ebd2c6345e2c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:14.368744 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c0fab825-6f7c-4875-917d-ebd2c6345e2c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:14.368744 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c0fab825-6f7c-4875-917d-ebd2c6345e2c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:14.504934 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-c0fab825-6f7c-4875-917d-ebd2c6345e2c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:14.515326 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-82f12cbd-40ad-457f-a1c0-4c08a3547670 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:14.515996 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-82f12cbd-40ad-457f-a1c0-4c08a3547670 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] [instance: 82497d59-5b76-4042-bd16-d88afa339f48] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:14.518539 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-c0fab825-6f7c-4875-917d-ebd2c6345e2c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad" status: 200 len: 1522 microversion: 2.1 time: 0.164087 May 10 21:22:14.519920 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 134/246] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:14 2022] GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:14.523212 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-82f12cbd-40ad-457f-a1c0-4c08a3547670 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:14.523653 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-82f12cbd-40ad-457f-a1c0-4c08a3547670 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:14.524914 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-82f12cbd-40ad-457f-a1c0-4c08a3547670 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:14.525345 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-82f12cbd-40ad-457f-a1c0-4c08a3547670 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:14.668148 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-82f12cbd-40ad-457f-a1c0-4c08a3547670 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dc62e15dfc4212bd91e0946e89dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda2d177aafc4fea94a790441a580fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:14.675952 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-82f12cbd-40ad-457f-a1c0-4c08a3547670 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] 10.222.0.25 "GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48" status: 200 len: 1275 microversion: 2.1 time: 0.165786 May 10 21:22:14.676538 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 113/247] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:14 2022] GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48 => generated 1275 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:15.205001 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-46427353-235e-4d0e-b205-8d558c02d251 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:15.205605 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-46427353-235e-4d0e-b205-8d558c02d251 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:15.212832 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-46427353-235e-4d0e-b205-8d558c02d251 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:15.213285 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-46427353-235e-4d0e-b205-8d558c02d251 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:15.214055 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-46427353-235e-4d0e-b205-8d558c02d251 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:15.214767 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-46427353-235e-4d0e-b205-8d558c02d251 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:15.351248 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-46427353-235e-4d0e-b205-8d558c02d251 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:15.360067 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-46427353-235e-4d0e-b205-8d558c02d251 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:15.361723 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-46427353-235e-4d0e-b205-8d558c02d251 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:15.362936 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-46427353-235e-4d0e-b205-8d558c02d251 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1723 microversion: 2.20 time: 0.162703 May 10 21:22:15.363514 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 135/248] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:22:15 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:22:15.536882 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4ebb8a53-1934-4aec-a90d-cc8320669f2c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:15.538350 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-4ebb8a53-1934-4aec-a90d-cc8320669f2c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:15.547668 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4ebb8a53-1934-4aec-a90d-cc8320669f2c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:15.548106 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4ebb8a53-1934-4aec-a90d-cc8320669f2c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:15.549210 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4ebb8a53-1934-4aec-a90d-cc8320669f2c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:15.549635 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4ebb8a53-1934-4aec-a90d-cc8320669f2c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:15.647942 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-f714ce39-d8a0-4a9c-943c-15c8e12e394e tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:15.648538 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-f714ce39-d8a0-4a9c-943c-15c8e12e394e tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:15.655709 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f714ce39-d8a0-4a9c-943c-15c8e12e394e tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:15.656213 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f714ce39-d8a0-4a9c-943c-15c8e12e394e tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:15.657015 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f714ce39-d8a0-4a9c-943c-15c8e12e394e tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:15.657473 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f714ce39-d8a0-4a9c-943c-15c8e12e394e tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:15.682016 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-f714ce39-d8a0-4a9c-943c-15c8e12e394e tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70/ips" status: 200 len: 144 microversion: 2.1 time: 0.038092 May 10 21:22:15.682637 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 136/249] 10.222.0.25 () {58 vars in 1247 bytes} [Tue May 10 21:22:15 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70/ips => generated 144 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:22:15.705750 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-b2b4e5e9-c4f9-4756-b235-3609c0db8a14 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:15.707542 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-b2b4e5e9-c4f9-4756-b235-3609c0db8a14 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] [instance: 82497d59-5b76-4042-bd16-d88afa339f48] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:15.715687 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b2b4e5e9-c4f9-4756-b235-3609c0db8a14 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:15.716645 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b2b4e5e9-c4f9-4756-b235-3609c0db8a14 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:15.717674 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b2b4e5e9-c4f9-4756-b235-3609c0db8a14 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:15.718131 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b2b4e5e9-c4f9-4756-b235-3609c0db8a14 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:15.774814 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-4ebb8a53-1934-4aec-a90d-cc8320669f2c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:15.785549 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4ebb8a53-1934-4aec-a90d-cc8320669f2c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad" status: 200 len: 1522 microversion: 2.1 time: 0.253232 May 10 21:22:15.810193 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 114/250] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:15 2022] GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:15.916482 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-b2b4e5e9-c4f9-4756-b235-3609c0db8a14 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dc62e15dfc4212bd91e0946e89dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda2d177aafc4fea94a790441a580fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:15.925686 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-b2b4e5e9-c4f9-4756-b235-3609c0db8a14 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] 10.222.0.25 "GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48" status: 200 len: 1315 microversion: 2.1 time: 0.235682 May 10 21:22:15.926374 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 137/251] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:15 2022] GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:16.382780 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-040dd721-bc8a-4ba2-9649-c5463c9eb527 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:16.383384 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-040dd721-bc8a-4ba2-9649-c5463c9eb527 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:16.391654 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-040dd721-bc8a-4ba2-9649-c5463c9eb527 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:16.392095 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-040dd721-bc8a-4ba2-9649-c5463c9eb527 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:16.392852 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-040dd721-bc8a-4ba2-9649-c5463c9eb527 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:16.393275 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-040dd721-bc8a-4ba2-9649-c5463c9eb527 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:16.614562 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-040dd721-bc8a-4ba2-9649-c5463c9eb527 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:16.622702 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-040dd721-bc8a-4ba2-9649-c5463c9eb527 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:16.625622 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-040dd721-bc8a-4ba2-9649-c5463c9eb527 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:16.627700 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-040dd721-bc8a-4ba2-9649-c5463c9eb527 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1723 microversion: 2.20 time: 0.249476 May 10 21:22:16.639148 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 115/252] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:22:16 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:22:16.803079 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-8498c582-70f1-40a9-9f0f-e2b2eccbce6d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:16.807526 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-8498c582-70f1-40a9-9f0f-e2b2eccbce6d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:16.812516 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8498c582-70f1-40a9-9f0f-e2b2eccbce6d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:16.812956 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8498c582-70f1-40a9-9f0f-e2b2eccbce6d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:16.813762 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8498c582-70f1-40a9-9f0f-e2b2eccbce6d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:16.814673 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8498c582-70f1-40a9-9f0f-e2b2eccbce6d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:16.853845 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-a0dd5f60-2c8d-4897-a5b5-9864e23b40df req-56a26443-816f-4969-a945-07c33077cd5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82497d59-5b76-4042-bd16-d88afa339f48", "tag": "84f501d5-9ad9-45d2-a2e3-8a462ef2a27a"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:22:16.868142 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-a0dd5f60-2c8d-4897-a5b5-9864e23b40df req-56a26443-816f-4969-a945-07c33077cd5e service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:16.871361 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-a0dd5f60-2c8d-4897-a5b5-9864e23b40df req-56a26443-816f-4969-a945-07c33077cd5e service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:16.886599 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-a0dd5f60-2c8d-4897-a5b5-9864e23b40df req-56a26443-816f-4969-a945-07c33077cd5e service nova] Creating event network-changed:84f501d5-9ad9-45d2-a2e3-8a462ef2a27a for instance 82497d59-5b76-4042-bd16-d88afa339f48 on hv-cinder-83608 May 10 21:22:16.895539 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-a0dd5f60-2c8d-4897-a5b5-9864e23b40df req-56a26443-816f-4969-a945-07c33077cd5e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046665 May 10 21:22:16.900182 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 116/253] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:22:16.947932 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-11447b72-881a-4b8c-a38f-50a43ec02c74 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:16.956700 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-11447b72-881a-4b8c-a38f-50a43ec02c74 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] [instance: 82497d59-5b76-4042-bd16-d88afa339f48] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:16.956902 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-11447b72-881a-4b8c-a38f-50a43ec02c74 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:16.957905 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-11447b72-881a-4b8c-a38f-50a43ec02c74 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:16.963280 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-11447b72-881a-4b8c-a38f-50a43ec02c74 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:16.964194 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-11447b72-881a-4b8c-a38f-50a43ec02c74 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:17.021127 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-8498c582-70f1-40a9-9f0f-e2b2eccbce6d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:17.031813 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-8498c582-70f1-40a9-9f0f-e2b2eccbce6d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad" status: 200 len: 1522 microversion: 2.1 time: 0.232316 May 10 21:22:17.037264 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 138/254] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:16 2022] GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:17.226062 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-11447b72-881a-4b8c-a38f-50a43ec02c74 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dc62e15dfc4212bd91e0946e89dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda2d177aafc4fea94a790441a580fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:17.234599 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-11447b72-881a-4b8c-a38f-50a43ec02c74 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] 10.222.0.25 "GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48" status: 200 len: 1315 microversion: 2.1 time: 0.291535 May 10 21:22:17.235330 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 117/255] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:16 2022] GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48 => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:17.645372 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-289b7930-597b-4d41-843e-03c988eac711 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:17.645975 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-289b7930-597b-4d41-843e-03c988eac711 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:17.652306 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-289b7930-597b-4d41-843e-03c988eac711 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:17.652969 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-289b7930-597b-4d41-843e-03c988eac711 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:17.653781 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-289b7930-597b-4d41-843e-03c988eac711 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:17.655033 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-289b7930-597b-4d41-843e-03c988eac711 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:17.822951 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-289b7930-597b-4d41-843e-03c988eac711 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:17.832187 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-289b7930-597b-4d41-843e-03c988eac711 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:17.833711 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-289b7930-597b-4d41-843e-03c988eac711 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:17.835119 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-289b7930-597b-4d41-843e-03c988eac711 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1723 microversion: 2.20 time: 0.193511 May 10 21:22:17.835858 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 139/256] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:22:17 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:22:18.017504 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-b74ccfbf-c156-40cf-9633-160e037d437b tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:18.018032 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-b74ccfbf-c156-40cf-9633-160e037d437b tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:18.024303 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b74ccfbf-c156-40cf-9633-160e037d437b tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:18.024791 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b74ccfbf-c156-40cf-9633-160e037d437b tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:18.025490 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b74ccfbf-c156-40cf-9633-160e037d437b tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:18.025914 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b74ccfbf-c156-40cf-9633-160e037d437b tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:18.049450 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-450da11f-2f89-4b44-ae1f-a2a7fbb60b77 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:18.049998 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-450da11f-2f89-4b44-ae1f-a2a7fbb60b77 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:18.050212 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-b74ccfbf-c156-40cf-9633-160e037d437b tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2/ips" status: 200 len: 150 microversion: 2.1 time: 0.037124 May 10 21:22:18.050946 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 118/257] 10.222.0.25 () {58 vars in 1247 bytes} [Tue May 10 21:22:18 2022] GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:22:18.056004 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-450da11f-2f89-4b44-ae1f-a2a7fbb60b77 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:18.056486 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-450da11f-2f89-4b44-ae1f-a2a7fbb60b77 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:18.057246 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-450da11f-2f89-4b44-ae1f-a2a7fbb60b77 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:18.057671 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-450da11f-2f89-4b44-ae1f-a2a7fbb60b77 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:18.189109 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-450da11f-2f89-4b44-ae1f-a2a7fbb60b77 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:18.196470 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-450da11f-2f89-4b44-ae1f-a2a7fbb60b77 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad" status: 200 len: 1522 microversion: 2.1 time: 0.151616 May 10 21:22:18.197046 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 140/258] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:18 2022] GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:18.257565 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-792bdb0f-5030-41fe-afe8-1eed44f0ef58 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:18.258211 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-792bdb0f-5030-41fe-afe8-1eed44f0ef58 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] [instance: 82497d59-5b76-4042-bd16-d88afa339f48] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:18.264479 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-792bdb0f-5030-41fe-afe8-1eed44f0ef58 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:18.264919 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-792bdb0f-5030-41fe-afe8-1eed44f0ef58 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:18.265675 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-792bdb0f-5030-41fe-afe8-1eed44f0ef58 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:18.266105 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-792bdb0f-5030-41fe-afe8-1eed44f0ef58 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:18.266321 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-6a85a4a3-f7fe-40e2-8e6c-a119ec58c9f3 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f3b229f0-6da6-4ebe-b2da-a0d6a972f85c"}} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:22:18.267467 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-6a85a4a3-f7fe-40e2-8e6c-a119ec58c9f3 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:18.273640 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6a85a4a3-f7fe-40e2-8e6c-a119ec58c9f3 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:18.274065 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6a85a4a3-f7fe-40e2-8e6c-a119ec58c9f3 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:18.274846 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6a85a4a3-f7fe-40e2-8e6c-a119ec58c9f3 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:18.275364 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6a85a4a3-f7fe-40e2-8e6c-a119ec58c9f3 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:18.396985 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-792bdb0f-5030-41fe-afe8-1eed44f0ef58 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dc62e15dfc4212bd91e0946e89dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda2d177aafc4fea94a790441a580fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:18.404813 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-792bdb0f-5030-41fe-afe8-1eed44f0ef58 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] 10.222.0.25 "GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48" status: 200 len: 1315 microversion: 2.1 time: 0.150880 May 10 21:22:18.405393 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 119/259] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:18 2022] GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:18.853684 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-2a98fc31-3564-484e-85fa-c5dfa11fcdaf tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:18.854406 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-2a98fc31-3564-484e-85fa-c5dfa11fcdaf tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:18.869641 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2a98fc31-3564-484e-85fa-c5dfa11fcdaf tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:18.869641 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2a98fc31-3564-484e-85fa-c5dfa11fcdaf tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:18.869641 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2a98fc31-3564-484e-85fa-c5dfa11fcdaf tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:18.869641 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2a98fc31-3564-484e-85fa-c5dfa11fcdaf tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:19.014172 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2a98fc31-3564-484e-85fa-c5dfa11fcdaf tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:19.022325 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2a98fc31-3564-484e-85fa-c5dfa11fcdaf tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:19.023851 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2a98fc31-3564-484e-85fa-c5dfa11fcdaf tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:19.025031 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-2a98fc31-3564-484e-85fa-c5dfa11fcdaf tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1723 microversion: 2.20 time: 0.175415 May 10 21:22:19.025578 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 120/260] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:22:18 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:22:19.213597 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-c8c81bd5-c4c2-42d2-86d8-d87e45b7da9e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:19.214197 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-c8c81bd5-c4c2-42d2-86d8-d87e45b7da9e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:19.220644 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c8c81bd5-c4c2-42d2-86d8-d87e45b7da9e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:19.221082 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c8c81bd5-c4c2-42d2-86d8-d87e45b7da9e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:19.221833 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c8c81bd5-c4c2-42d2-86d8-d87e45b7da9e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:19.222254 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c8c81bd5-c4c2-42d2-86d8-d87e45b7da9e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:19.494505 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-c8c81bd5-c4c2-42d2-86d8-d87e45b7da9e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:19.501987 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-c8c81bd5-c4c2-42d2-86d8-d87e45b7da9e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad" status: 200 len: 1522 microversion: 2.1 time: 0.292705 May 10 21:22:19.502588 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 121/261] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:19 2022] GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:22:19.507179 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-de5f26f9-fd15-471d-bffd-857204ffac37 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:19.507777 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-de5f26f9-fd15-471d-bffd-857204ffac37 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] [instance: 82497d59-5b76-4042-bd16-d88afa339f48] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:19.514002 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-de5f26f9-fd15-471d-bffd-857204ffac37 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:19.514464 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-de5f26f9-fd15-471d-bffd-857204ffac37 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:19.515217 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-de5f26f9-fd15-471d-bffd-857204ffac37 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:19.515656 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-de5f26f9-fd15-471d-bffd-857204ffac37 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:19.642461 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-de5f26f9-fd15-471d-bffd-857204ffac37 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dc62e15dfc4212bd91e0946e89dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda2d177aafc4fea94a790441a580fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:19.652531 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-de5f26f9-fd15-471d-bffd-857204ffac37 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] 10.222.0.25 "GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48" status: 200 len: 1315 microversion: 2.1 time: 0.148789 May 10 21:22:19.653069 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 122/262] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:19 2022] GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:19.724458 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-07882f93-85a7-4c88-8a5b-660170bee70d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "535e59b4-e36b-41e8-9eec-d0042c1bfca9"}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:22:19.725914 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-07882f93-85a7-4c88-8a5b-660170bee70d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:19.747129 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-07882f93-85a7-4c88-8a5b-660170bee70d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:19.750725 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-07882f93-85a7-4c88-8a5b-660170bee70d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:19.761352 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-07882f93-85a7-4c88-8a5b-660170bee70d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:19.761352 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-07882f93-85a7-4c88-8a5b-660170bee70d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:20.390158 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-6a85a4a3-f7fe-40e2-8e6c-a119ec58c9f3 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "POST /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.127538 May 10 21:22:20.390822 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 141/263] 10.222.0.25 () {60 vars in 1322 bytes} [Tue May 10 21:22:18 2022] POST /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70/os-volume_attachments => generated 194 bytes in 2129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:22:20.396825 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-2719324c-876a-4cec-9b4e-25d1fcfed299 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:20.397676 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-2719324c-876a-4cec-9b4e-25d1fcfed299 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:20.404639 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2719324c-876a-4cec-9b4e-25d1fcfed299 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:20.405092 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2719324c-876a-4cec-9b4e-25d1fcfed299 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:20.405890 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2719324c-876a-4cec-9b4e-25d1fcfed299 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:20.406329 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2719324c-876a-4cec-9b4e-25d1fcfed299 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:20.546953 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-2719324c-876a-4cec-9b4e-25d1fcfed299 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:20.554933 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-2719324c-876a-4cec-9b4e-25d1fcfed299 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:20.556478 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-2719324c-876a-4cec-9b4e-25d1fcfed299 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:20.557637 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-2719324c-876a-4cec-9b4e-25d1fcfed299 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1723 microversion: 2.20 time: 0.165435 May 10 21:22:20.558249 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 142/264] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:22:20 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:22:20.563945 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-c69da92c-617f-4504-9317-2cdb1bbfac36 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:20.564545 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-c69da92c-617f-4504-9317-2cdb1bbfac36 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:20.570414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c69da92c-617f-4504-9317-2cdb1bbfac36 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:20.570889 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c69da92c-617f-4504-9317-2cdb1bbfac36 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:20.571704 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c69da92c-617f-4504-9317-2cdb1bbfac36 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:20.572208 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c69da92c-617f-4504-9317-2cdb1bbfac36 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:20.699873 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-c69da92c-617f-4504-9317-2cdb1bbfac36 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:20.710708 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-07882f93-85a7-4c88-8a5b-660170bee70d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "POST /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.991824 May 10 21:22:20.714577 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 123/265] 10.222.0.25 () {60 vars in 1322 bytes} [Tue May 10 21:22:19 2022] POST /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2/os-volume_attachments => generated 194 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:22:20.719461 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-5bebfa08-a3fa-4f02-8a29-47e01d6bbd70 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:20.720158 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-5bebfa08-a3fa-4f02-8a29-47e01d6bbd70 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] [instance: 82497d59-5b76-4042-bd16-d88afa339f48] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:20.725007 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-c69da92c-617f-4504-9317-2cdb1bbfac36 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad" status: 200 len: 1522 microversion: 2.1 time: 0.165558 May 10 21:22:20.725795 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 143/266] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:20 2022] GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:20.731751 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5bebfa08-a3fa-4f02-8a29-47e01d6bbd70 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:20.733569 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5bebfa08-a3fa-4f02-8a29-47e01d6bbd70 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:20.734552 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5bebfa08-a3fa-4f02-8a29-47e01d6bbd70 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:20.735184 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5bebfa08-a3fa-4f02-8a29-47e01d6bbd70 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:20.896252 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-5bebfa08-a3fa-4f02-8a29-47e01d6bbd70 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dc62e15dfc4212bd91e0946e89dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda2d177aafc4fea94a790441a580fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:20.908021 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-5bebfa08-a3fa-4f02-8a29-47e01d6bbd70 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] 10.222.0.25 "GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48" status: 200 len: 1315 microversion: 2.1 time: 0.194419 May 10 21:22:20.908910 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 124/267] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:20 2022] GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:21.578128 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-cb62ebe3-7081-4ed1-b142-a95a516e7335 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:21.578860 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-cb62ebe3-7081-4ed1-b142-a95a516e7335 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:21.585238 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-cb62ebe3-7081-4ed1-b142-a95a516e7335 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:21.585687 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-cb62ebe3-7081-4ed1-b142-a95a516e7335 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:21.586475 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-cb62ebe3-7081-4ed1-b142-a95a516e7335 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:21.586918 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-cb62ebe3-7081-4ed1-b142-a95a516e7335 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:21.714877 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-cb62ebe3-7081-4ed1-b142-a95a516e7335 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:21.723117 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-cb62ebe3-7081-4ed1-b142-a95a516e7335 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:21.724625 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-cb62ebe3-7081-4ed1-b142-a95a516e7335 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:21.725776 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-cb62ebe3-7081-4ed1-b142-a95a516e7335 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1723 microversion: 2.20 time: 0.152478 May 10 21:22:21.726380 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 144/268] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:22:21 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:22:21.749074 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-12b341c5-8958-40b6-bc5e-07ebd934364a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:21.755396 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-12b341c5-8958-40b6-bc5e-07ebd934364a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:21.756369 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-12b341c5-8958-40b6-bc5e-07ebd934364a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:21.757147 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-12b341c5-8958-40b6-bc5e-07ebd934364a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:21.758167 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-12b341c5-8958-40b6-bc5e-07ebd934364a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:21.758636 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-12b341c5-8958-40b6-bc5e-07ebd934364a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:21.893680 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-12b341c5-8958-40b6-bc5e-07ebd934364a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:21.901082 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-12b341c5-8958-40b6-bc5e-07ebd934364a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad" status: 200 len: 1502 microversion: 2.1 time: 0.157000 May 10 21:22:21.901659 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 125/269] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:21 2022] GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:21.917456 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-acd680af-113b-421e-b5e4-d4eb500385ec tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6adbcc84-6d93-4a9f-9cec-ba20a9c84a10"}} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:22:21.918651 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-acd680af-113b-421e-b5e4-d4eb500385ec tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:21.925072 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-d25a588b-38eb-4987-931d-3099f91c1ff7 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:21.925255 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-acd680af-113b-421e-b5e4-d4eb500385ec tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:21.925691 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-d25a588b-38eb-4987-931d-3099f91c1ff7 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] [instance: 82497d59-5b76-4042-bd16-d88afa339f48] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:21.925787 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-acd680af-113b-421e-b5e4-d4eb500385ec tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:21.926472 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-acd680af-113b-421e-b5e4-d4eb500385ec tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:21.926911 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-acd680af-113b-421e-b5e4-d4eb500385ec tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:21.931773 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d25a588b-38eb-4987-931d-3099f91c1ff7 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:21.932214 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d25a588b-38eb-4987-931d-3099f91c1ff7 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:21.932961 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d25a588b-38eb-4987-931d-3099f91c1ff7 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:21.933387 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d25a588b-38eb-4987-931d-3099f91c1ff7 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:21.949992 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.wsgi [None req-acd680af-113b-421e-b5e4-d4eb500385ec tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] HTTP exception thrown: Cannot 'attach_volume' instance e4ec9c2a-8806-4da8-9072-ca136cfa83ad while it is in vm_state rescued May 10 21:22:21.951825 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-acd680af-113b-421e-b5e4-d4eb500385ec tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Request method failure captured: May 10 21:22:21.951825 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: request: POST /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad/os-volume_attachments HTTP/1.1 May 10 21:22:21.951825 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept: application/json May 10 21:22:21.951825 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept-Encoding: identity May 10 21:22:21.951825 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Connection: close May 10 21:22:21.951825 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Length: 74 May 10 21:22:21.951825 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Type: application/json May 10 21:22:21.951825 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Host: 10.222.0.25 May 10 21:22:21.951825 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Openstack-System-Scope: None May 10 21:22:21.951825 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: User-Agent: python-urllib3/1.26.9 May 10 21:22:21.951825 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Auth-Token: gAAAAABietceoa2YDFp3vDe6jovGDog94X8BICE9yqvDWgY5jdGYdkHB2lHnE5qpy-JGn-DuIb7JDkx8klyX_PhGtRnUB4IyuUehUiSCq89-lTpBX74SCgCRj4KBQmjjs3BGumQQ03DMZXdd0ZUBAC18LfTUVRuOE-vNOyfC2OTzFN94f1GAdHA May 10 21:22:21.951825 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Id: None May 10 21:22:21.951825 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Name: None May 10 21:22:21.951825 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Identity-Status: Confirmed May 10 21:22:21.951825 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Is-Admin-Project: True May 10 21:22:21.951825 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Id: default May 10 21:22:21.951825 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Name: Default May 10 21:22:21.951825 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Id: 78072ca90bf6402b83863597c266a178 May 10 21:22:21.951825 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-845733436 May 10 21:22:21.951825 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Role: member,reader May 10 21:22:21.951825 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Roles: member,reader May 10 21:22:21.953326 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78072ca90bf6402b83863597c266a178"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_78072ca90bf6402b83863597c266a178"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78072ca90bf6402b83863597c266a178"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/78072ca90bf6402b83863597c266a178"}]}] May 10 21:22:21.953326 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant: tempest-ServerRescueNegativeTestJSON-845733436 May 10 21:22:21.953326 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Id: 78072ca90bf6402b83863597c266a178 May 10 21:22:21.953326 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-845733436 May 10 21:22:21.953326 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User: tempest-ServerRescueNegativeTestJSON-845733436-project May 10 21:22:21.953326 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Id: default May 10 21:22:21.953326 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Name: Default May 10 21:22:21.953326 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Id: 02af0eded57547f489be63cd6dc09399 May 10 21:22:21.953326 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Name: tempest-ServerRescueNegativeTestJSON-845733436-project May 10 21:22:21.953326 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: May 10 21:22:21.953326 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: {"volumeAttachment": {"volumeId": "6adbcc84-6d93-4a9f-9cec-ba20a9c84a10"}} May 10 21:22:21.953326 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: method: > May 10 21:22:21.957830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: exception: Cannot 'attach_volume' instance e4ec9c2a-8806-4da8-9072-ca136cfa83ad while it is in vm_state rescued May 10 21:22:21.957830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: action_args: {'server_id': 'e4ec9c2a-8806-4da8-9072-ca136cfa83ad', 'body': {'volumeAttachment': {'volumeId': '6adbcc84-6d93-4a9f-9cec-ba20a9c84a10'}}} May 10 21:22:21.957830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:22:21.957830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:22:21.957830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 10 21:22:21.957830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 10 21:22:21.957830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 21:22:21.957830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 21:22:21.957830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 10 21:22:21.957830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 10 21:22:21.957830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e4ec9c2a-8806-4da8-9072-ca136cfa83ad in vm_state rescued. Cannot attach_volume while the instance is in this state. May 10 21:22:21.957830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:22:21.957830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:22:21.957830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:22:21.957830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:22:21.957830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:22:21.957830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:22:21.957830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:22:21.957830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:22:21.959213 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:22:21.959213 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:22:21.959213 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 21:22:21.959213 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 21:22:21.959213 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 21:22:21.959213 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 21:22:21.959213 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 21:22:21.959213 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 21:22:21.959213 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 10 21:22:21.959213 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 10 21:22:21.959213 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 10 21:22:21.959213 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 21:22:21.959213 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e4ec9c2a-8806-4da8-9072-ca136cfa83ad while it is in vm_state rescued May 10 21:22:21.959213 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:22:21.959213 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:22:21.959213 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:22:21.959213 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:22:21.959213 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:22:21.959213 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:22:21.960453 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:22:21.960453 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:22:21.960453 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e4ec9c2a-8806-4da8-9072-ca136cfa83ad while it is in vm_state rescued May 10 21:22:21.960453 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:22:21.960453 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-acd680af-113b-421e-b5e4-d4eb500385ec tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Returning 409 to user: Cannot 'attach_volume' instance e4ec9c2a-8806-4da8-9072-ca136cfa83ad while it is in vm_state rescued {{(pid=117678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:22:21.960453 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-acd680af-113b-421e-b5e4-d4eb500385ec tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "POST /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.039815 May 10 21:22:21.960453 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 145/270] 10.222.0.25 () {60 vars in 1322 bytes} [Tue May 10 21:22:21 2022] POST /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad/os-volume_attachments => generated 152 bytes in 41 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 10 21:22:21.962316 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-5aac289b-53b8-4184-b1b8-4975ca10c786 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:22:21.962924 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-5aac289b-53b8-4184-b1b8-4975ca10c786 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:21.968980 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5aac289b-53b8-4184-b1b8-4975ca10c786 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:21.969418 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5aac289b-53b8-4184-b1b8-4975ca10c786 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:21.970175 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5aac289b-53b8-4184-b1b8-4975ca10c786 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:21.970635 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5aac289b-53b8-4184-b1b8-4975ca10c786 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:22.061971 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-d25a588b-38eb-4987-931d-3099f91c1ff7 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dc62e15dfc4212bd91e0946e89dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda2d177aafc4fea94a790441a580fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:22.069248 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-d25a588b-38eb-4987-931d-3099f91c1ff7 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] 10.222.0.25 "GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48" status: 200 len: 1315 microversion: 2.1 time: 0.147826 May 10 21:22:22.069809 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 126/271] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:21 2022] GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:22:22.155349 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-5aac289b-53b8-4184-b1b8-4975ca10c786 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "POST /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad/action" status: 202 len: 0 microversion: 2.1 time: 0.196595 May 10 21:22:22.156023 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 146/272] 10.222.0.25 () {60 vars in 1277 bytes} [Tue May 10 21:22:21 2022] POST /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 21:22:22.165067 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-89bbe77a-5ccf-4f0e-ac3f-547df3bd435a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:22.165666 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-89bbe77a-5ccf-4f0e-ac3f-547df3bd435a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:22.172133 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-89bbe77a-5ccf-4f0e-ac3f-547df3bd435a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:22.172575 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-89bbe77a-5ccf-4f0e-ac3f-547df3bd435a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:22.173332 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-89bbe77a-5ccf-4f0e-ac3f-547df3bd435a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:22.173761 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-89bbe77a-5ccf-4f0e-ac3f-547df3bd435a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:22.298875 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-89bbe77a-5ccf-4f0e-ac3f-547df3bd435a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:22.306179 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-89bbe77a-5ccf-4f0e-ac3f-547df3bd435a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad" status: 200 len: 1510 microversion: 2.1 time: 0.144940 May 10 21:22:22.306770 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 127/273] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:22 2022] GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad => generated 1510 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:22.745031 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-75aaa726-6642-4e18-a560-a63aa8595d58 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:22.745722 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-75aaa726-6642-4e18-a560-a63aa8595d58 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:22.752737 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-75aaa726-6642-4e18-a560-a63aa8595d58 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:22.753177 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-75aaa726-6642-4e18-a560-a63aa8595d58 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:22.753937 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-75aaa726-6642-4e18-a560-a63aa8595d58 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:22.754363 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-75aaa726-6642-4e18-a560-a63aa8595d58 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:22.898134 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-75aaa726-6642-4e18-a560-a63aa8595d58 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:22.906658 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-75aaa726-6642-4e18-a560-a63aa8595d58 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:22.908149 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-75aaa726-6642-4e18-a560-a63aa8595d58 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:22.909295 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-75aaa726-6642-4e18-a560-a63aa8595d58 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1723 microversion: 2.20 time: 0.168990 May 10 21:22:22.909851 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 147/274] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:22:22 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:22:23.086518 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-20a957cc-94b6-4382-8ca6-964162c309b1 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:23.086518 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-20a957cc-94b6-4382-8ca6-964162c309b1 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] [instance: 82497d59-5b76-4042-bd16-d88afa339f48] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:23.093497 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-20a957cc-94b6-4382-8ca6-964162c309b1 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:23.093939 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-20a957cc-94b6-4382-8ca6-964162c309b1 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:23.094714 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-20a957cc-94b6-4382-8ca6-964162c309b1 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:23.095140 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-20a957cc-94b6-4382-8ca6-964162c309b1 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:23.323972 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-ff91cada-34e2-4408-8dd4-92cd9c144082 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:23.325174 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-ff91cada-34e2-4408-8dd4-92cd9c144082 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:23.331832 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ff91cada-34e2-4408-8dd4-92cd9c144082 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:23.332278 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ff91cada-34e2-4408-8dd4-92cd9c144082 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:23.333063 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ff91cada-34e2-4408-8dd4-92cd9c144082 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:23.333499 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ff91cada-34e2-4408-8dd4-92cd9c144082 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:23.448199 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-20a957cc-94b6-4382-8ca6-964162c309b1 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dc62e15dfc4212bd91e0946e89dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda2d177aafc4fea94a790441a580fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:23.456708 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-20a957cc-94b6-4382-8ca6-964162c309b1 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] 10.222.0.25 "GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48" status: 200 len: 1315 microversion: 2.1 time: 0.374631 May 10 21:22:23.462496 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 128/275] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:23 2022] GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48 => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:23.474407 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-ff91cada-34e2-4408-8dd4-92cd9c144082 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:23.482696 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-ff91cada-34e2-4408-8dd4-92cd9c144082 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad" status: 200 len: 1510 microversion: 2.1 time: 0.161951 May 10 21:22:23.483267 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 148/276] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:23 2022] GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:22:23.530909 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-f16e177f-c1af-47bf-a490-6e46c8372b83 req-3d5dd4a3-7a14-46c6-a5d2-20850cb4e8fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82497d59-5b76-4042-bd16-d88afa339f48", "name": "network-vif-plugged", "status": "completed", "tag": "84f501d5-9ad9-45d2-a2e3-8a462ef2a27a"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:22:23.538928 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-f16e177f-c1af-47bf-a490-6e46c8372b83 req-3d5dd4a3-7a14-46c6-a5d2-20850cb4e8fc service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:23.539359 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-f16e177f-c1af-47bf-a490-6e46c8372b83 req-3d5dd4a3-7a14-46c6-a5d2-20850cb4e8fc service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:23.550639 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-f16e177f-c1af-47bf-a490-6e46c8372b83 req-3d5dd4a3-7a14-46c6-a5d2-20850cb4e8fc service nova] Creating event network-vif-plugged:84f501d5-9ad9-45d2-a2e3-8a462ef2a27a for instance 82497d59-5b76-4042-bd16-d88afa339f48 on hv-cinder-83608 May 10 21:22:23.555784 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-f16e177f-c1af-47bf-a490-6e46c8372b83 req-3d5dd4a3-7a14-46c6-a5d2-20850cb4e8fc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029236 May 10 21:22:23.557421 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 129/277] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:22:23.928005 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-4b3da64d-6c13-4c0d-ae06-33c128bebbed tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:23.928637 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-4b3da64d-6c13-4c0d-ae06-33c128bebbed tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:23.935711 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4b3da64d-6c13-4c0d-ae06-33c128bebbed tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:23.936166 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4b3da64d-6c13-4c0d-ae06-33c128bebbed tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:23.936946 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4b3da64d-6c13-4c0d-ae06-33c128bebbed tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:23.937372 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4b3da64d-6c13-4c0d-ae06-33c128bebbed tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:24.063968 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-4b3da64d-6c13-4c0d-ae06-33c128bebbed tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:24.071770 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-4b3da64d-6c13-4c0d-ae06-33c128bebbed tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:24.073275 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-4b3da64d-6c13-4c0d-ae06-33c128bebbed tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:24.074472 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-4b3da64d-6c13-4c0d-ae06-33c128bebbed tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1723 microversion: 2.20 time: 0.150318 May 10 21:22:24.075025 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 149/278] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:22:23 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:22:24.473344 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-aee44516-890c-49c0-a210-6c52820a1f2d tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:24.474033 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-aee44516-890c-49c0-a210-6c52820a1f2d tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] [instance: 82497d59-5b76-4042-bd16-d88afa339f48] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:24.480739 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-aee44516-890c-49c0-a210-6c52820a1f2d tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:24.481186 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-aee44516-890c-49c0-a210-6c52820a1f2d tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:24.482529 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-aee44516-890c-49c0-a210-6c52820a1f2d tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:24.482973 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-aee44516-890c-49c0-a210-6c52820a1f2d tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:24.500950 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-c0504050-067c-4d0a-a956-9650640f9c62 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:24.501140 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-c0504050-067c-4d0a-a956-9650640f9c62 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:24.507666 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c0504050-067c-4d0a-a956-9650640f9c62 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:24.508313 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c0504050-067c-4d0a-a956-9650640f9c62 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:24.509162 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c0504050-067c-4d0a-a956-9650640f9c62 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:24.509661 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c0504050-067c-4d0a-a956-9650640f9c62 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:24.750202 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-aee44516-890c-49c0-a210-6c52820a1f2d tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dc62e15dfc4212bd91e0946e89dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda2d177aafc4fea94a790441a580fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:24.762407 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-aee44516-890c-49c0-a210-6c52820a1f2d tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] 10.222.0.25 "GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48" status: 200 len: 1315 microversion: 2.1 time: 0.293188 May 10 21:22:24.764855 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 130/279] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:24 2022] GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:24.882602 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-c0504050-067c-4d0a-a956-9650640f9c62 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:24.891129 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-c0504050-067c-4d0a-a956-9650640f9c62 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad" status: 200 len: 1510 microversion: 2.1 time: 0.395114 May 10 21:22:24.891965 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 150/280] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:24 2022] GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad => generated 1510 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:22:25.094277 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-fa5ab78f-a8fd-4ff1-9eec-e592b068f617 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:25.094919 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-fa5ab78f-a8fd-4ff1-9eec-e592b068f617 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:25.101502 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fa5ab78f-a8fd-4ff1-9eec-e592b068f617 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:25.101977 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fa5ab78f-a8fd-4ff1-9eec-e592b068f617 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:25.103218 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fa5ab78f-a8fd-4ff1-9eec-e592b068f617 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:25.103806 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fa5ab78f-a8fd-4ff1-9eec-e592b068f617 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:25.284451 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-fa5ab78f-a8fd-4ff1-9eec-e592b068f617 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:25.292416 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-fa5ab78f-a8fd-4ff1-9eec-e592b068f617 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:25.294264 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-fa5ab78f-a8fd-4ff1-9eec-e592b068f617 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:25.295823 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-fa5ab78f-a8fd-4ff1-9eec-e592b068f617 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1723 microversion: 2.20 time: 0.206749 May 10 21:22:25.296466 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 131/281] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:22:25 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:22:25.779934 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-102dba5b-bd9a-4ba7-876e-5f6a0dbecf7b tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:25.780536 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-102dba5b-bd9a-4ba7-876e-5f6a0dbecf7b tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] [instance: 82497d59-5b76-4042-bd16-d88afa339f48] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:25.786917 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-102dba5b-bd9a-4ba7-876e-5f6a0dbecf7b tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:25.787361 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-102dba5b-bd9a-4ba7-876e-5f6a0dbecf7b tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:25.788116 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-102dba5b-bd9a-4ba7-876e-5f6a0dbecf7b tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:25.788542 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-102dba5b-bd9a-4ba7-876e-5f6a0dbecf7b tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:25.908694 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-1de0df47-1dfb-439c-a4e6-c3620cda33ab tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:25.909387 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-1de0df47-1dfb-439c-a4e6-c3620cda33ab tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:25.915859 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1de0df47-1dfb-439c-a4e6-c3620cda33ab tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:25.916029 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-102dba5b-bd9a-4ba7-876e-5f6a0dbecf7b tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dc62e15dfc4212bd91e0946e89dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda2d177aafc4fea94a790441a580fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:25.916451 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1de0df47-1dfb-439c-a4e6-c3620cda33ab tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:25.917278 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1de0df47-1dfb-439c-a4e6-c3620cda33ab tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:25.917774 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1de0df47-1dfb-439c-a4e6-c3620cda33ab tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:25.924283 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-102dba5b-bd9a-4ba7-876e-5f6a0dbecf7b tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] 10.222.0.25 "GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48" status: 200 len: 1315 microversion: 2.1 time: 0.148221 May 10 21:22:25.924851 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 151/282] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:25 2022] GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:26.049605 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1de0df47-1dfb-439c-a4e6-c3620cda33ab tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:26.057036 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-1de0df47-1dfb-439c-a4e6-c3620cda33ab tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad" status: 200 len: 1510 microversion: 2.1 time: 0.152172 May 10 21:22:26.057596 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 132/283] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:25 2022] GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:26.315101 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-37a0a70b-37c4-4922-b1cf-e7c2cdf398c3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:26.315852 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-37a0a70b-37c4-4922-b1cf-e7c2cdf398c3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:26.322111 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-37a0a70b-37c4-4922-b1cf-e7c2cdf398c3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:26.322594 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-37a0a70b-37c4-4922-b1cf-e7c2cdf398c3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:26.323370 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-37a0a70b-37c4-4922-b1cf-e7c2cdf398c3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:26.323799 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-37a0a70b-37c4-4922-b1cf-e7c2cdf398c3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:26.458697 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-37a0a70b-37c4-4922-b1cf-e7c2cdf398c3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:26.467665 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-37a0a70b-37c4-4922-b1cf-e7c2cdf398c3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:26.469177 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-37a0a70b-37c4-4922-b1cf-e7c2cdf398c3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:26.470377 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-37a0a70b-37c4-4922-b1cf-e7c2cdf398c3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1723 microversion: 2.20 time: 0.159236 May 10 21:22:26.473562 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 152/284] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:22:26 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:22:26.941186 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-d9a04834-14fe-4829-8435-8095bdfa8626 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:26.941874 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-d9a04834-14fe-4829-8435-8095bdfa8626 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] [instance: 82497d59-5b76-4042-bd16-d88afa339f48] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:26.948236 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d9a04834-14fe-4829-8435-8095bdfa8626 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:26.948677 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d9a04834-14fe-4829-8435-8095bdfa8626 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:26.949455 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d9a04834-14fe-4829-8435-8095bdfa8626 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:26.949876 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d9a04834-14fe-4829-8435-8095bdfa8626 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:27.073751 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-989842ec-79d7-4276-99bc-f618377edf2f tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:27.074416 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-989842ec-79d7-4276-99bc-f618377edf2f tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:27.088571 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-989842ec-79d7-4276-99bc-f618377edf2f tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:27.088571 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-989842ec-79d7-4276-99bc-f618377edf2f tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:27.088860 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-d9a04834-14fe-4829-8435-8095bdfa8626 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dc62e15dfc4212bd91e0946e89dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda2d177aafc4fea94a790441a580fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:27.088986 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-989842ec-79d7-4276-99bc-f618377edf2f tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:27.088986 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-989842ec-79d7-4276-99bc-f618377edf2f tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:27.090598 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-d9a04834-14fe-4829-8435-8095bdfa8626 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] 10.222.0.25 "GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48" status: 200 len: 1315 microversion: 2.1 time: 0.153209 May 10 21:22:27.091441 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 133/285] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:26 2022] GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:27.215596 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-989842ec-79d7-4276-99bc-f618377edf2f tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:27.224081 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-989842ec-79d7-4276-99bc-f618377edf2f tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad" status: 200 len: 1510 microversion: 2.1 time: 0.154749 May 10 21:22:27.224644 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 153/286] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:27 2022] GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:22:27.488870 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-d438d582-75b1-4428-b9aa-6b2ac445602b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:27.489479 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-d438d582-75b1-4428-b9aa-6b2ac445602b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:27.495560 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d438d582-75b1-4428-b9aa-6b2ac445602b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:27.496003 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d438d582-75b1-4428-b9aa-6b2ac445602b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:27.496762 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d438d582-75b1-4428-b9aa-6b2ac445602b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:27.497858 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d438d582-75b1-4428-b9aa-6b2ac445602b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:27.627113 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-d438d582-75b1-4428-b9aa-6b2ac445602b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:27.635398 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-d438d582-75b1-4428-b9aa-6b2ac445602b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:27.641137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-d438d582-75b1-4428-b9aa-6b2ac445602b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:27.641137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-d438d582-75b1-4428-b9aa-6b2ac445602b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1723 microversion: 2.20 time: 0.153258 May 10 21:22:27.641137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 134/287] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:22:27 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:22:28.108317 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-c761efed-c8f2-4d97-afde-f5d53fd2e2e1 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:28.108935 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-c761efed-c8f2-4d97-afde-f5d53fd2e2e1 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] [instance: 82497d59-5b76-4042-bd16-d88afa339f48] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:28.115770 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c761efed-c8f2-4d97-afde-f5d53fd2e2e1 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:28.116222 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c761efed-c8f2-4d97-afde-f5d53fd2e2e1 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:28.116997 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c761efed-c8f2-4d97-afde-f5d53fd2e2e1 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:28.117429 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c761efed-c8f2-4d97-afde-f5d53fd2e2e1 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:28.241208 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-3372ce53-ff8b-4355-b6a8-d746df7b04f8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:28.242536 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-3372ce53-ff8b-4355-b6a8-d746df7b04f8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:28.250233 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3372ce53-ff8b-4355-b6a8-d746df7b04f8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:28.250711 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3372ce53-ff8b-4355-b6a8-d746df7b04f8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:28.251529 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3372ce53-ff8b-4355-b6a8-d746df7b04f8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:28.251961 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3372ce53-ff8b-4355-b6a8-d746df7b04f8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:28.258308 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-c761efed-c8f2-4d97-afde-f5d53fd2e2e1 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dc62e15dfc4212bd91e0946e89dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda2d177aafc4fea94a790441a580fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:28.266749 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-c761efed-c8f2-4d97-afde-f5d53fd2e2e1 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] 10.222.0.25 "GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48" status: 200 len: 1465 microversion: 2.1 time: 0.162740 May 10 21:22:28.267309 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 154/288] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:28 2022] GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48 => generated 1465 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:28.344703 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-87a0e8a9-2c20-4906-8c89-f118c33cb0c6 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:28.345208 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-87a0e8a9-2c20-4906-8c89-f118c33cb0c6 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] [instance: 82497d59-5b76-4042-bd16-d88afa339f48] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:28.354786 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-87a0e8a9-2c20-4906-8c89-f118c33cb0c6 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:28.356338 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-87a0e8a9-2c20-4906-8c89-f118c33cb0c6 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:28.357560 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-87a0e8a9-2c20-4906-8c89-f118c33cb0c6 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:28.358002 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-87a0e8a9-2c20-4906-8c89-f118c33cb0c6 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:28.394148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-87a0e8a9-2c20-4906-8c89-f118c33cb0c6 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] [instance: 82497d59-5b76-4042-bd16-d88afa339f48] Going to try to terminate instance {{(pid=117678) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 21:22:28.411883 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-3372ce53-ff8b-4355-b6a8-d746df7b04f8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:28.419937 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-3372ce53-ff8b-4355-b6a8-d746df7b04f8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad" status: 200 len: 1516 microversion: 2.1 time: 0.182345 May 10 21:22:28.420819 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 135/289] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:28 2022] GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad => generated 1516 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:22:28.631520 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-87a0e8a9-2c20-4906-8c89-f118c33cb0c6 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] 10.222.0.25 "DELETE /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48" status: 204 len: 0 microversion: 2.1 time: 0.292164 May 10 21:22:28.632247 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 155/290] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 10 21:22:28 2022] DELETE /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 21:22:28.640894 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-ef620f2b-ea62-4cfc-8cf0-fc4718c40091 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:28.641502 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-ef620f2b-ea62-4cfc-8cf0-fc4718c40091 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] [instance: 82497d59-5b76-4042-bd16-d88afa339f48] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:28.647406 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ef620f2b-ea62-4cfc-8cf0-fc4718c40091 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:28.649229 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ef620f2b-ea62-4cfc-8cf0-fc4718c40091 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:28.649229 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ef620f2b-ea62-4cfc-8cf0-fc4718c40091 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:28.649229 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ef620f2b-ea62-4cfc-8cf0-fc4718c40091 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:28.658342 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-2ccc00ec-4a53-44a7-8271-5b1d06069f4c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:28.659094 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-2ccc00ec-4a53-44a7-8271-5b1d06069f4c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:28.664995 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2ccc00ec-4a53-44a7-8271-5b1d06069f4c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:28.665437 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2ccc00ec-4a53-44a7-8271-5b1d06069f4c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:28.666217 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2ccc00ec-4a53-44a7-8271-5b1d06069f4c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:28.666667 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2ccc00ec-4a53-44a7-8271-5b1d06069f4c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:28.806022 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-2ccc00ec-4a53-44a7-8271-5b1d06069f4c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:28.814482 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-2ccc00ec-4a53-44a7-8271-5b1d06069f4c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:28.815143 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-ef620f2b-ea62-4cfc-8cf0-fc4718c40091 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dc62e15dfc4212bd91e0946e89dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda2d177aafc4fea94a790441a580fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:28.816113 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-2ccc00ec-4a53-44a7-8271-5b1d06069f4c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:28.817625 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-2ccc00ec-4a53-44a7-8271-5b1d06069f4c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1723 microversion: 2.20 time: 0.163729 May 10 21:22:28.817742 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 156/291] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:22:28 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:22:28.824081 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-ef620f2b-ea62-4cfc-8cf0-fc4718c40091 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] 10.222.0.25 "GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48" status: 200 len: 1471 microversion: 2.1 time: 0.187573 May 10 21:22:28.824645 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 136/292] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:28 2022] GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48 => generated 1471 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:29.847534 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-2d31bdb5-4885-482f-90bd-662b5d78e535 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:29.851877 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-1a801b47-be74-473b-8ec0-a1c5809ca264 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:29.852502 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-1a801b47-be74-473b-8ec0-a1c5809ca264 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] [instance: 82497d59-5b76-4042-bd16-d88afa339f48] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:29.856239 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-2d31bdb5-4885-482f-90bd-662b5d78e535 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:29.863839 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1a801b47-be74-473b-8ec0-a1c5809ca264 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:29.864286 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1a801b47-be74-473b-8ec0-a1c5809ca264 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:29.865059 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1a801b47-be74-473b-8ec0-a1c5809ca264 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:29.865651 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1a801b47-be74-473b-8ec0-a1c5809ca264 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:29.873421 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2d31bdb5-4885-482f-90bd-662b5d78e535 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:29.873962 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2d31bdb5-4885-482f-90bd-662b5d78e535 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:29.874824 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2d31bdb5-4885-482f-90bd-662b5d78e535 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:29.875259 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2d31bdb5-4885-482f-90bd-662b5d78e535 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:30.000988 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1a801b47-be74-473b-8ec0-a1c5809ca264 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dc62e15dfc4212bd91e0946e89dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda2d177aafc4fea94a790441a580fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:30.008805 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-1a801b47-be74-473b-8ec0-a1c5809ca264 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] 10.222.0.25 "GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48" status: 200 len: 1471 microversion: 2.1 time: 0.160602 May 10 21:22:30.009377 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 137/293] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:29 2022] GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48 => generated 1471 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:22:30.084061 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-2d31bdb5-4885-482f-90bd-662b5d78e535 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:30.092424 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-2d31bdb5-4885-482f-90bd-662b5d78e535 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:30.094085 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-2d31bdb5-4885-482f-90bd-662b5d78e535 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:30.095277 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-2d31bdb5-4885-482f-90bd-662b5d78e535 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1723 microversion: 2.20 time: 0.254369 May 10 21:22:30.095845 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 157/294] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:22:29 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:22:31.026267 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-1c66b149-5687-46b3-a50b-ff7a504e59a5 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:31.026920 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-1c66b149-5687-46b3-a50b-ff7a504e59a5 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] [instance: 82497d59-5b76-4042-bd16-d88afa339f48] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:31.034033 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1c66b149-5687-46b3-a50b-ff7a504e59a5 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:31.034508 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1c66b149-5687-46b3-a50b-ff7a504e59a5 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:31.035309 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1c66b149-5687-46b3-a50b-ff7a504e59a5 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:31.035742 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1c66b149-5687-46b3-a50b-ff7a504e59a5 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:31.114972 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-dabe3ba4-fd20-4ac3-89a9-4a393ab04d46 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:31.115794 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-dabe3ba4-fd20-4ac3-89a9-4a393ab04d46 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:31.128242 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-dabe3ba4-fd20-4ac3-89a9-4a393ab04d46 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:31.129253 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-dabe3ba4-fd20-4ac3-89a9-4a393ab04d46 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:31.130820 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-dabe3ba4-fd20-4ac3-89a9-4a393ab04d46 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:31.131489 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-dabe3ba4-fd20-4ac3-89a9-4a393ab04d46 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:31.178080 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1c66b149-5687-46b3-a50b-ff7a504e59a5 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dc62e15dfc4212bd91e0946e89dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda2d177aafc4fea94a790441a580fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:31.185619 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-1c66b149-5687-46b3-a50b-ff7a504e59a5 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] 10.222.0.25 "GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48" status: 200 len: 1471 microversion: 2.1 time: 0.163108 May 10 21:22:31.186402 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 138/295] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:31 2022] GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48 => generated 1471 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:31.273183 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-dabe3ba4-fd20-4ac3-89a9-4a393ab04d46 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:31.281143 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-dabe3ba4-fd20-4ac3-89a9-4a393ab04d46 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:31.282690 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-dabe3ba4-fd20-4ac3-89a9-4a393ab04d46 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:31.283837 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-dabe3ba4-fd20-4ac3-89a9-4a393ab04d46 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1723 microversion: 2.20 time: 0.173971 May 10 21:22:31.284402 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 158/296] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:22:31 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:22:32.184159 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-75f5f3cb-a60e-445e-882f-3f43eb15c40a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Action: 'create', calling method: .version_select at 0x7f7aea746c10>, body: {"keypair": {"name": "tempest-keypair-1203990376", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcj//3jEckXJfHrFGuxAppw1hSosBT+CALa9FiCpYt9ik8GD/c7QXYyeJB5fAY50szxx8w7NcXOv9wrNRjbpTvTY1eWeSwrUwG6BaqehafX/XLUxE8q31b2MsqISjGNeQ=="}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:22:32.204156 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-75f5f3cb-a60e-445e-882f-3f43eb15c40a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Getting quotas for project 78072ca90bf6402b83863597c266a178. Resources: {'key_pairs'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:22:32.204508 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-d5c4bbca-5692-4306-abe6-0419006423b0 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:32.206971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-d5c4bbca-5692-4306-abe6-0419006423b0 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] [instance: 82497d59-5b76-4042-bd16-d88afa339f48] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:32.208204 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-75f5f3cb-a60e-445e-882f-3f43eb15c40a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Getting quotas for user 02af0eded57547f489be63cd6dc09399 and project 78072ca90bf6402b83863597c266a178. Resources: {'key_pairs'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:22:32.217558 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d5c4bbca-5692-4306-abe6-0419006423b0 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:32.218076 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d5c4bbca-5692-4306-abe6-0419006423b0 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:32.219150 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d5c4bbca-5692-4306-abe6-0419006423b0 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:32.219581 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d5c4bbca-5692-4306-abe6-0419006423b0 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:32.296571 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-75f5f3cb-a60e-445e-882f-3f43eb15c40a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.117661 May 10 21:22:32.298089 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 139/297] 10.222.0.25 () {60 vars in 1158 bytes} [Tue May 10 21:22:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:22:32.306423 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-d6a52640-14d6-4158-b9a9-86ea5e0bb9fb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:32.307444 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-d6a52640-14d6-4158-b9a9-86ea5e0bb9fb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:32.315041 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d6a52640-14d6-4158-b9a9-86ea5e0bb9fb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:32.320745 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d6a52640-14d6-4158-b9a9-86ea5e0bb9fb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:32.320745 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d6a52640-14d6-4158-b9a9-86ea5e0bb9fb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:32.320745 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d6a52640-14d6-4158-b9a9-86ea5e0bb9fb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:32.378161 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-d5c4bbca-5692-4306-abe6-0419006423b0 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dc62e15dfc4212bd91e0946e89dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda2d177aafc4fea94a790441a580fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:32.388173 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-d5c4bbca-5692-4306-abe6-0419006423b0 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] 10.222.0.25 "GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48" status: 200 len: 1471 microversion: 2.1 time: 0.189355 May 10 21:22:32.398093 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 159/298] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:32 2022] GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48 => generated 1471 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:32.466858 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-d6a52640-14d6-4158-b9a9-86ea5e0bb9fb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:32.474814 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-d6a52640-14d6-4158-b9a9-86ea5e0bb9fb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:32.476314 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-d6a52640-14d6-4158-b9a9-86ea5e0bb9fb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:32.477464 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-d6a52640-14d6-4158-b9a9-86ea5e0bb9fb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1723 microversion: 2.20 time: 0.178375 May 10 21:22:32.478019 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 140/299] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:22:32 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:22:33.405229 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-75f124f6-1b0e-4e1f-8664-9d471b7e231b tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:33.405781 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-75f124f6-1b0e-4e1f-8664-9d471b7e231b tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] [instance: 82497d59-5b76-4042-bd16-d88afa339f48] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:33.412188 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-75f124f6-1b0e-4e1f-8664-9d471b7e231b tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:33.412637 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-75f124f6-1b0e-4e1f-8664-9d471b7e231b tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:33.413409 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-75f124f6-1b0e-4e1f-8664-9d471b7e231b tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:33.413845 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-75f124f6-1b0e-4e1f-8664-9d471b7e231b tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:33.496684 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-dec92f1e-e784-41e3-8893-54d045bd263b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:33.497893 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-dec92f1e-e784-41e3-8893-54d045bd263b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:33.507880 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-75f124f6-1b0e-4e1f-8664-9d471b7e231b tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dc62e15dfc4212bd91e0946e89dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda2d177aafc4fea94a790441a580fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:33.518240 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dec92f1e-e784-41e3-8893-54d045bd263b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:33.519421 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-75f124f6-1b0e-4e1f-8664-9d471b7e231b tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] 10.222.0.25 "GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48" status: 200 len: 1429 microversion: 2.1 time: 0.117455 May 10 21:22:33.519548 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dec92f1e-e784-41e3-8893-54d045bd263b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:33.520383 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dec92f1e-e784-41e3-8893-54d045bd263b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:33.521072 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dec92f1e-e784-41e3-8893-54d045bd263b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:33.527041 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 160/300] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:33 2022] GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48 => generated 1429 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:33.536183 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-5adb788a-f355-4709-8d19-2f6bcdfe3773 req-83d4e10f-3ffa-4232-acf0-d4cf330b6444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82497d59-5b76-4042-bd16-d88afa339f48", "name": "network-vif-deleted", "tag": "84f501d5-9ad9-45d2-a2e3-8a462ef2a27a"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:22:33.553767 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-5adb788a-f355-4709-8d19-2f6bcdfe3773 req-83d4e10f-3ffa-4232-acf0-d4cf330b6444 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:33.554552 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-5adb788a-f355-4709-8d19-2f6bcdfe3773 req-83d4e10f-3ffa-4232-acf0-d4cf330b6444 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:33.570692 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-5adb788a-f355-4709-8d19-2f6bcdfe3773 req-83d4e10f-3ffa-4232-acf0-d4cf330b6444 service nova] Creating event network-vif-deleted:84f501d5-9ad9-45d2-a2e3-8a462ef2a27a for instance 82497d59-5b76-4042-bd16-d88afa339f48 on hv-cinder-83608 May 10 21:22:33.579161 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-5adb788a-f355-4709-8d19-2f6bcdfe3773 req-83d4e10f-3ffa-4232-acf0-d4cf330b6444 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047809 May 10 21:22:33.580275 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 161/301] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:22:33.681942 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-dec92f1e-e784-41e3-8893-54d045bd263b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:33.695812 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-dec92f1e-e784-41e3-8893-54d045bd263b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:33.697359 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-dec92f1e-e784-41e3-8893-54d045bd263b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:33.698551 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-dec92f1e-e784-41e3-8893-54d045bd263b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1744 microversion: 2.20 time: 0.206108 May 10 21:22:33.699240 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 141/302] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:22:33 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1744 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:22:33.928885 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-51372947-bff9-4c5c-9475-1e2562a469cb tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:22:33.935339 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-51372947-bff9-4c5c-9475-1e2562a469cb tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:33.935844 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-51372947-bff9-4c5c-9475-1e2562a469cb tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:33.999094 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-51372947-bff9-4c5c-9475-1e2562a469cb tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Going to try to stop instance {{(pid=117678) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 10 21:22:34.206191 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-51372947-bff9-4c5c-9475-1e2562a469cb tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "POST /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70/action" status: 202 len: 0 microversion: 2.1 time: 0.281403 May 10 21:22:34.206991 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 162/303] 10.222.0.25 () {60 vars in 1277 bytes} [Tue May 10 21:22:33 2022] POST /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 21:22:34.215147 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a540650e-f3e2-4942-bd47-ecbe8546d26c tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:34.215755 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-a540650e-f3e2-4942-bd47-ecbe8546d26c tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:34.222467 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a540650e-f3e2-4942-bd47-ecbe8546d26c tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:34.228617 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a540650e-f3e2-4942-bd47-ecbe8546d26c tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:34.228617 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a540650e-f3e2-4942-bd47-ecbe8546d26c tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:34.228617 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a540650e-f3e2-4942-bd47-ecbe8546d26c tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:34.421601 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-a540650e-f3e2-4942-bd47-ecbe8546d26c tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:34.430167 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-a540650e-f3e2-4942-bd47-ecbe8546d26c tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1720 microversion: 2.1 time: 0.218693 May 10 21:22:34.441790 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 142/304] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:34 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1720 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:34.536867 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-84be4d58-7037-4c8e-8227-ef764911d8e0 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:34.537658 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-84be4d58-7037-4c8e-8227-ef764911d8e0 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] [instance: 82497d59-5b76-4042-bd16-d88afa339f48] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:34.543810 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-84be4d58-7037-4c8e-8227-ef764911d8e0 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:34.544942 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-84be4d58-7037-4c8e-8227-ef764911d8e0 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:34.545996 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-84be4d58-7037-4c8e-8227-ef764911d8e0 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:34.546542 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-84be4d58-7037-4c8e-8227-ef764911d8e0 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:34.586085 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-84be4d58-7037-4c8e-8227-ef764911d8e0 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:34.586553 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-84be4d58-7037-4c8e-8227-ef764911d8e0 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:34.587163 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.objects.instance [None req-84be4d58-7037-4c8e-8227-ef764911d8e0 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lazy-loading 'fault' on Instance uuid 82497d59-5b76-4042-bd16-d88afa339f48 {{(pid=117678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:22:34.647595 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-84be4d58-7037-4c8e-8227-ef764911d8e0 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dc62e15dfc4212bd91e0946e89dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda2d177aafc4fea94a790441a580fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:34.657818 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-84be4d58-7037-4c8e-8227-ef764911d8e0 tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] 10.222.0.25 "GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48" status: 200 len: 1305 microversion: 2.1 time: 0.125565 May 10 21:22:34.658413 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 163/305] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:34 2022] GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48 => generated 1305 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:34.722132 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-cd4df095-f95e-49fe-ab48-5846e9f1f447 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:34.722779 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-cd4df095-f95e-49fe-ab48-5846e9f1f447 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:34.732677 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cd4df095-f95e-49fe-ab48-5846e9f1f447 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:34.733780 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cd4df095-f95e-49fe-ab48-5846e9f1f447 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:34.741351 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cd4df095-f95e-49fe-ab48-5846e9f1f447 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:34.741651 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cd4df095-f95e-49fe-ab48-5846e9f1f447 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:34.754073 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-3ad21804-2dca-424c-b81a-e5e5a693b1d7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1449415992", "imageRef": "2d72b3e0-7d02-481e-b5e6-17f44e8729d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f4d68030-42b4-44a7-8e2e-1f92daeefa7f"}], "security_groups": [{"name": "tempest-securitygroup--443091158"}], "key_name": "tempest-keypair-1203990376", "user_data": "}} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:22:34.928939 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.network.neutron [None req-3ad21804-2dca-424c-b81a-e5e5a693b1d7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] validate_networks() for [('f4d68030-42b4-44a7-8e2e-1f92daeefa7f', None, None, None, None, None)] {{(pid=117678) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 21:22:34.976839 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-cd4df095-f95e-49fe-ab48-5846e9f1f447 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:34.990721 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-cd4df095-f95e-49fe-ab48-5846e9f1f447 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:34.992393 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-cd4df095-f95e-49fe-ab48-5846e9f1f447 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:34.993610 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-cd4df095-f95e-49fe-ab48-5846e9f1f447 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1744 microversion: 2.20 time: 0.275903 May 10 21:22:34.994189 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 143/306] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:22:34 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1744 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:22:35.326177 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-3ad21804-2dca-424c-b81a-e5e5a693b1d7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Flavor limits 0:0:0 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 21:22:35.326636 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-3ad21804-2dca-424c-b81a-e5e5a693b1d7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Image limits 0:0:0 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 21:22:35.327304 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-3ad21804-2dca-424c-b81a-e5e5a693b1d7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Flavor pref 0:0:0 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 21:22:35.327720 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-3ad21804-2dca-424c-b81a-e5e5a693b1d7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Image pref 0:0:0 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 21:22:35.328137 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-3ad21804-2dca-424c-b81a-e5e5a693b1d7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 21:22:35.339882 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3ad21804-2dca-424c-b81a-e5e5a693b1d7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:35.339882 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3ad21804-2dca-424c-b81a-e5e5a693b1d7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:35.339882 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3ad21804-2dca-424c-b81a-e5e5a693b1d7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:35.339882 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3ad21804-2dca-424c-b81a-e5e5a693b1d7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:35.373614 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.quota [None req-3ad21804-2dca-424c-b81a-e5e5a693b1d7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Getting quotas for project 78072ca90bf6402b83863597c266a178. Resources: {'cores', 'instances', 'ram'} {{(pid=117678) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:22:35.377634 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.quota [None req-3ad21804-2dca-424c-b81a-e5e5a693b1d7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Getting quotas for user 02af0eded57547f489be63cd6dc09399 and project 78072ca90bf6402b83863597c266a178. Resources: {'cores', 'instances', 'ram'} {{(pid=117678) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:22:35.389201 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-3ad21804-2dca-424c-b81a-e5e5a693b1d7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Going to run 1 instances... {{(pid=117678) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 21:22:35.391527 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-3ad21804-2dca-424c-b81a-e5e5a693b1d7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d72b3e0-7d02-481e-b5e6-17f44e8729d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 21:22:35.448073 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-c7e0f5fe-9403-4395-aede-65196dbad075 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:35.449817 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-c7e0f5fe-9403-4395-aede-65196dbad075 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:35.455746 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c7e0f5fe-9403-4395-aede-65196dbad075 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:35.456192 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c7e0f5fe-9403-4395-aede-65196dbad075 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:35.456977 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c7e0f5fe-9403-4395-aede-65196dbad075 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:35.457409 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c7e0f5fe-9403-4395-aede-65196dbad075 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:35.548928 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-3ad21804-2dca-424c-b81a-e5e5a693b1d7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.799165 May 10 21:22:35.550296 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 164/307] 10.222.0.25 () {60 vars in 1146 bytes} [Tue May 10 21:22:34 2022] POST /compute/v2.1/servers => generated 408 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 21:22:35.561106 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-f78edaae-2c60-4d0d-9f59-7ddd61611ef4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:35.562117 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-f78edaae-2c60-4d0d-9f59-7ddd61611ef4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:35.610127 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-c7e0f5fe-9403-4395-aede-65196dbad075 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:35.621720 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-c7e0f5fe-9403-4395-aede-65196dbad075 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1720 microversion: 2.1 time: 0.177309 May 10 21:22:35.623748 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 144/308] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:35 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1720 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:22:35.640206 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-f78edaae-2c60-4d0d-9f59-7ddd61611ef4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:35.647062 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-f78edaae-2c60-4d0d-9f59-7ddd61611ef4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1246 microversion: 2.1 time: 0.090792 May 10 21:22:35.647639 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 165/309] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:35 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1246 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:35.678085 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6680ad9b-08e6-464b-915d-b0f62f1a8e0e tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:35.678798 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-6680ad9b-08e6-464b-915d-b0f62f1a8e0e tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] [instance: 82497d59-5b76-4042-bd16-d88afa339f48] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:35.684974 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6680ad9b-08e6-464b-915d-b0f62f1a8e0e tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:35.686059 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6680ad9b-08e6-464b-915d-b0f62f1a8e0e tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:35.686876 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6680ad9b-08e6-464b-915d-b0f62f1a8e0e tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:35.687309 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6680ad9b-08e6-464b-915d-b0f62f1a8e0e tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:35.704280 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-6680ad9b-08e6-464b-915d-b0f62f1a8e0e tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] HTTP exception thrown: Instance 82497d59-5b76-4042-bd16-d88afa339f48 could not be found. May 10 21:22:35.706011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6680ad9b-08e6-464b-915d-b0f62f1a8e0e tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Request method failure captured: May 10 21:22:35.706011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: request: GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48 HTTP/1.1 May 10 21:22:35.706011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept: application/json May 10 21:22:35.706011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity May 10 21:22:35.706011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Connection: close May 10 21:22:35.706011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Length: 0 May 10 21:22:35.706011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Type: application/json May 10 21:22:35.706011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Host: 10.222.0.25 May 10 21:22:35.706011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None May 10 21:22:35.706011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 May 10 21:22:35.706011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABietd9E0DhBxUqAeMA1OEM5YdZXemWiaP07uPYh39yanAPhytKmZTa3Y7YxGAA3wkjotNh64kNYzS9U_JjKJrOSh13K003VXO7EO-H1UPa8TWafh0NZ4dkznzhi3ti-1T8sMbsv5wO2ElkWxN8bnsoTao6CeglXkWtpAnLgIsBTfqoQ7A May 10 21:22:35.706011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Id: None May 10 21:22:35.706011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Name: None May 10 21:22:35.706011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed May 10 21:22:35.706011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True May 10 21:22:35.706011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default May 10 21:22:35.706011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default May 10 21:22:35.706011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Id: eda2d177aafc4fea94a790441a580fcf May 10 21:22:35.706011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-VolumesNegativeTest-640779991 May 10 21:22:35.706011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Role: member,reader May 10 21:22:35.706011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Roles: member,reader May 10 21:22:35.707438 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eda2d177aafc4fea94a790441a580fcf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eda2d177aafc4fea94a790441a580fcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eda2d177aafc4fea94a790441a580fcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eda2d177aafc4fea94a790441a580fcf"}]}] May 10 21:22:35.707438 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-VolumesNegativeTest-640779991 May 10 21:22:35.707438 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Id: eda2d177aafc4fea94a790441a580fcf May 10 21:22:35.707438 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-VolumesNegativeTest-640779991 May 10 21:22:35.707438 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User: tempest-VolumesNegativeTest-640779991-project May 10 21:22:35.707438 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default May 10 21:22:35.707438 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default May 10 21:22:35.707438 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Id: 84dc62e15dfc4212bd91e0946e89dd9d May 10 21:22:35.707438 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-VolumesNegativeTest-640779991-project May 10 21:22:35.707438 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: method: > May 10 21:22:35.707438 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: exception: Instance 82497d59-5b76-4042-bd16-d88afa339f48 could not be found. May 10 21:22:35.707438 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: action_args: {'id': '82497d59-5b76-4042-bd16-d88afa339f48'} May 10 21:22:35.708253 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:22:35.708253 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:22:35.708253 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:22:35.708253 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:22:35.708253 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:22:35.708253 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:22:35.708253 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:22:35.708253 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:22:35.708253 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:22:35.708253 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:22:35.708253 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82497d59-5b76-4042-bd16-d88afa339f48 could not be found. May 10 21:22:35.708253 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:22:35.708253 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:22:35.708253 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:22:35.708253 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:22:35.708253 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:22:35.708253 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:22:35.708253 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:22:35.708253 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:22:35.708253 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:22:35.709497 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:22:35.709497 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:22:35.709497 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:22:35.709497 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:22:35.709497 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:22:35.709497 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:22:35.709497 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:22:35.709497 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82497d59-5b76-4042-bd16-d88afa339f48 could not be found. May 10 21:22:35.709497 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:22:35.709497 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:22:35.709497 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:22:35.709497 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:22:35.709497 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:22:35.709497 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:22:35.709497 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:22:35.709497 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:22:35.709497 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82497d59-5b76-4042-bd16-d88afa339f48 could not be found. May 10 21:22:35.709497 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:22:35.710566 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6680ad9b-08e6-464b-915d-b0f62f1a8e0e tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] Returning 404 to user: Instance 82497d59-5b76-4042-bd16-d88afa339f48 could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:22:35.710566 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-6680ad9b-08e6-464b-915d-b0f62f1a8e0e tempest-VolumesNegativeTest-640779991 tempest-VolumesNegativeTest-640779991-project] 10.222.0.25 "GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48" status: 404 len: 111 microversion: 2.1 time: 0.036220 May 10 21:22:35.710566 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 145/310] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:35 2022] GET /compute/v2.1/servers/82497d59-5b76-4042-bd16-d88afa339f48 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:22:36.012628 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-15c20dc3-7959-4168-a37e-4af8cdc78d94 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:36.014058 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-15c20dc3-7959-4168-a37e-4af8cdc78d94 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:36.020290 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-15c20dc3-7959-4168-a37e-4af8cdc78d94 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:36.020737 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-15c20dc3-7959-4168-a37e-4af8cdc78d94 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:36.021525 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-15c20dc3-7959-4168-a37e-4af8cdc78d94 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:36.025102 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-15c20dc3-7959-4168-a37e-4af8cdc78d94 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:36.167325 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-15c20dc3-7959-4168-a37e-4af8cdc78d94 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:36.177918 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-15c20dc3-7959-4168-a37e-4af8cdc78d94 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:36.179773 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-15c20dc3-7959-4168-a37e-4af8cdc78d94 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:36.181056 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-15c20dc3-7959-4168-a37e-4af8cdc78d94 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1739 microversion: 2.20 time: 0.172373 May 10 21:22:36.182014 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 166/311] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:22:36 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:22:36.520572 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-a503afa6-765b-416f-8f9e-ad78dafde9ea req-ac104885-0d12-4217-b93f-c2133943ff66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef19cfc2-aeb2-40ff-b25c-187304690869", "name": "network-vif-plugged", "status": "completed", "tag": "83ef924d-2caa-4d5a-8fb2-cd0a871c9712"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:22:36.535223 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-a503afa6-765b-416f-8f9e-ad78dafde9ea req-ac104885-0d12-4217-b93f-c2133943ff66 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:36.536330 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-a503afa6-765b-416f-8f9e-ad78dafde9ea req-ac104885-0d12-4217-b93f-c2133943ff66 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:36.549901 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-a503afa6-765b-416f-8f9e-ad78dafde9ea req-ac104885-0d12-4217-b93f-c2133943ff66 service nova] Creating event network-vif-plugged:83ef924d-2caa-4d5a-8fb2-cd0a871c9712 for instance ef19cfc2-aeb2-40ff-b25c-187304690869 on hv-cinder-83608 May 10 21:22:36.555971 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-a503afa6-765b-416f-8f9e-ad78dafde9ea req-ac104885-0d12-4217-b93f-c2133943ff66 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038974 May 10 21:22:36.556772 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 146/312] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:22:36.640966 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-5e3e7a3b-8977-4901-a9b6-0c7057d9db78 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:36.641751 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-5e3e7a3b-8977-4901-a9b6-0c7057d9db78 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:36.658759 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5e3e7a3b-8977-4901-a9b6-0c7057d9db78 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:36.663949 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5e3e7a3b-8977-4901-a9b6-0c7057d9db78 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:36.663949 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5e3e7a3b-8977-4901-a9b6-0c7057d9db78 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:36.663949 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5e3e7a3b-8977-4901-a9b6-0c7057d9db78 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:36.664971 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-f1294d34-36be-4791-8c6f-ae0942631e99 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:36.665667 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-f1294d34-36be-4791-8c6f-ae0942631e99 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:36.680257 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f1294d34-36be-4791-8c6f-ae0942631e99 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:36.687903 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f1294d34-36be-4791-8c6f-ae0942631e99 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:36.692665 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f1294d34-36be-4791-8c6f-ae0942631e99 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:36.693770 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f1294d34-36be-4791-8c6f-ae0942631e99 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:36.811499 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-f1294d34-36be-4791-8c6f-ae0942631e99 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:36.825002 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-f1294d34-36be-4791-8c6f-ae0942631e99 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1250 microversion: 2.1 time: 0.164141 May 10 21:22:36.837720 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 147/313] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:36 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1250 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:22:36.932271 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-5e3e7a3b-8977-4901-a9b6-0c7057d9db78 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:36.942181 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-5e3e7a3b-8977-4901-a9b6-0c7057d9db78 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1720 microversion: 2.1 time: 0.305154 May 10 21:22:36.943069 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 167/314] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:36 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1720 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:37.203831 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-7bd8f759-57e8-432c-b09f-6dfb2e3b29dc tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:37.203831 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-7bd8f759-57e8-432c-b09f-6dfb2e3b29dc tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:37.256658 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7bd8f759-57e8-432c-b09f-6dfb2e3b29dc tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:37.256658 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7bd8f759-57e8-432c-b09f-6dfb2e3b29dc tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:37.256658 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7bd8f759-57e8-432c-b09f-6dfb2e3b29dc tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:37.256658 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7bd8f759-57e8-432c-b09f-6dfb2e3b29dc tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:37.472946 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-7bd8f759-57e8-432c-b09f-6dfb2e3b29dc tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:37.485325 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-7bd8f759-57e8-432c-b09f-6dfb2e3b29dc tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:37.486958 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-7bd8f759-57e8-432c-b09f-6dfb2e3b29dc tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:37.488342 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-7bd8f759-57e8-432c-b09f-6dfb2e3b29dc tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1739 microversion: 2.20 time: 0.291160 May 10 21:22:37.489319 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 148/315] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:22:37 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1739 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:22:37.844874 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-4bbc2079-5426-441e-87ea-77b22fd1e52a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:37.846842 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-4bbc2079-5426-441e-87ea-77b22fd1e52a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:37.855755 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4bbc2079-5426-441e-87ea-77b22fd1e52a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:37.856459 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4bbc2079-5426-441e-87ea-77b22fd1e52a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:37.857846 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4bbc2079-5426-441e-87ea-77b22fd1e52a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:37.858482 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4bbc2079-5426-441e-87ea-77b22fd1e52a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:37.937757 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-4bbc2079-5426-441e-87ea-77b22fd1e52a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:37.970573 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-015703e7-bad2-4707-af36-72b74f9d79e4 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:37.971898 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-015703e7-bad2-4707-af36-72b74f9d79e4 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:37.981407 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-015703e7-bad2-4707-af36-72b74f9d79e4 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:37.982157 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-4bbc2079-5426-441e-87ea-77b22fd1e52a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1298 microversion: 2.1 time: 0.138784 May 10 21:22:37.992792 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-015703e7-bad2-4707-af36-72b74f9d79e4 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:37.993032 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 168/316] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:37 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1298 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:37.993138 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-015703e7-bad2-4707-af36-72b74f9d79e4 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:37.993138 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-015703e7-bad2-4707-af36-72b74f9d79e4 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:38.144965 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-015703e7-bad2-4707-af36-72b74f9d79e4 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:38.158224 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-015703e7-bad2-4707-af36-72b74f9d79e4 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1720 microversion: 2.1 time: 0.198539 May 10 21:22:38.168043 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 149/317] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:37 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1720 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:38.511769 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-7a7cd90c-b8ff-4256-abb3-8c6967eac9d3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:38.511769 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-7a7cd90c-b8ff-4256-abb3-8c6967eac9d3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:38.525129 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7a7cd90c-b8ff-4256-abb3-8c6967eac9d3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:38.525582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7a7cd90c-b8ff-4256-abb3-8c6967eac9d3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:38.526368 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7a7cd90c-b8ff-4256-abb3-8c6967eac9d3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:38.527020 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7a7cd90c-b8ff-4256-abb3-8c6967eac9d3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:38.782064 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-7a7cd90c-b8ff-4256-abb3-8c6967eac9d3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:38.791601 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-7a7cd90c-b8ff-4256-abb3-8c6967eac9d3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:38.795025 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-7a7cd90c-b8ff-4256-abb3-8c6967eac9d3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:38.796801 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-7a7cd90c-b8ff-4256-abb3-8c6967eac9d3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1739 microversion: 2.20 time: 0.289737 May 10 21:22:38.802183 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 169/318] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:22:38 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1739 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:22:39.011016 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-efa3589c-c8e9-4de2-9bbe-e7add0c9c28d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:39.016350 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-efa3589c-c8e9-4de2-9bbe-e7add0c9c28d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:39.037764 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-efa3589c-c8e9-4de2-9bbe-e7add0c9c28d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:39.039740 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-efa3589c-c8e9-4de2-9bbe-e7add0c9c28d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:39.040593 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-efa3589c-c8e9-4de2-9bbe-e7add0c9c28d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:39.041042 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-efa3589c-c8e9-4de2-9bbe-e7add0c9c28d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:39.135280 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-efa3589c-c8e9-4de2-9bbe-e7add0c9c28d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:39.147989 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-efa3589c-c8e9-4de2-9bbe-e7add0c9c28d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1304 microversion: 2.1 time: 0.143945 May 10 21:22:39.148978 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 150/319] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:38 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1304 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:22:39.181780 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-625541dc-bb65-4fc3-b366-bce4f5d855c0 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:39.183426 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-625541dc-bb65-4fc3-b366-bce4f5d855c0 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:39.216353 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-625541dc-bb65-4fc3-b366-bce4f5d855c0 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:39.216791 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-625541dc-bb65-4fc3-b366-bce4f5d855c0 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:39.223014 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-625541dc-bb65-4fc3-b366-bce4f5d855c0 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:39.223668 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-625541dc-bb65-4fc3-b366-bce4f5d855c0 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:39.444455 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-625541dc-bb65-4fc3-b366-bce4f5d855c0 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:39.456687 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-625541dc-bb65-4fc3-b366-bce4f5d855c0 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1720 microversion: 2.1 time: 0.278676 May 10 21:22:39.457525 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 170/320] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:39 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1720 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:39.821483 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-b5443ed2-9c98-4c68-8e87-173fa23a3fae tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:39.822119 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-b5443ed2-9c98-4c68-8e87-173fa23a3fae tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:39.828534 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b5443ed2-9c98-4c68-8e87-173fa23a3fae tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:39.828993 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b5443ed2-9c98-4c68-8e87-173fa23a3fae tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:39.829912 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b5443ed2-9c98-4c68-8e87-173fa23a3fae tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:39.830351 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b5443ed2-9c98-4c68-8e87-173fa23a3fae tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:40.009255 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b5443ed2-9c98-4c68-8e87-173fa23a3fae tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:40.037352 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b5443ed2-9c98-4c68-8e87-173fa23a3fae tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:40.040100 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b5443ed2-9c98-4c68-8e87-173fa23a3fae tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:40.041618 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-b5443ed2-9c98-4c68-8e87-173fa23a3fae tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1739 microversion: 2.20 time: 0.224890 May 10 21:22:40.042274 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 151/321] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:22:39 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1739 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:22:40.177483 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-c2304341-a197-458d-b1c5-4d2d7ca07454 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:40.180465 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-c2304341-a197-458d-b1c5-4d2d7ca07454 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:40.191441 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c2304341-a197-458d-b1c5-4d2d7ca07454 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:40.226306 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c2304341-a197-458d-b1c5-4d2d7ca07454 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:40.226306 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c2304341-a197-458d-b1c5-4d2d7ca07454 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:40.226306 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c2304341-a197-458d-b1c5-4d2d7ca07454 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:40.336020 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-c2304341-a197-458d-b1c5-4d2d7ca07454 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:40.344132 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-c2304341-a197-458d-b1c5-4d2d7ca07454 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1371 microversion: 2.1 time: 0.176402 May 10 21:22:40.344937 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 171/322] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:40 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:40.473711 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-2ad42755-6d4c-4126-b3a6-0e4da843bb04 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:40.474373 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-2ad42755-6d4c-4126-b3a6-0e4da843bb04 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:40.480327 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2ad42755-6d4c-4126-b3a6-0e4da843bb04 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:40.480716 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2ad42755-6d4c-4126-b3a6-0e4da843bb04 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:40.481488 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2ad42755-6d4c-4126-b3a6-0e4da843bb04 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:40.482561 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2ad42755-6d4c-4126-b3a6-0e4da843bb04 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:40.741173 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2ad42755-6d4c-4126-b3a6-0e4da843bb04 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:40.755967 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-2ad42755-6d4c-4126-b3a6-0e4da843bb04 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1720 microversion: 2.1 time: 0.285400 May 10 21:22:40.756828 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 152/323] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:40 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1720 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:40.920639 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-fdb257d7-4238-48e9-b915-09c0ca6b1dec tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Action: 'create', calling method: .version_select at 0x7f7aea53b1f0>, body: {"keypair": {"name": "tempest-keypair-1009693388", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8fJcMdjUEZsKiDNoNY5e/+wiPfCIpjBOhvwr/Bbg4VKVoBP/dl0SUzRocjjijb+RGyaHPT0ptEL49osw4Qoo+FIE3qbrc7FozZBr3MpdOHDQIHu/aWv04/aDhf5z6IHQ=="}} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:22:40.947639 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.quota [None req-fdb257d7-4238-48e9-b915-09c0ca6b1dec tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Getting quotas for project 8286226c580f4896aec72c65642fce30. Resources: {'key_pairs'} {{(pid=117678) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:22:40.954972 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.quota [None req-fdb257d7-4238-48e9-b915-09c0ca6b1dec tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Getting quotas for user ca39678abe6e476283f94c675d4ea369 and project 8286226c580f4896aec72c65642fce30. Resources: {'key_pairs'} {{(pid=117678) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:22:41.062839 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-fdb257d7-4238-48e9-b915-09c0ca6b1dec tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.147616 May 10 21:22:41.063529 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a9b46077-c890-4917-8ce3-dd59989be8b0 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:41.064252 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-a9b46077-c890-4917-8ce3-dd59989be8b0 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:41.064875 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 172/324] 10.222.0.25 () {60 vars in 1158 bytes} [Tue May 10 21:22:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:22:41.073586 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a9b46077-c890-4917-8ce3-dd59989be8b0 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:41.075156 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a9b46077-c890-4917-8ce3-dd59989be8b0 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:41.077267 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a9b46077-c890-4917-8ce3-dd59989be8b0 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:41.080104 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a9b46077-c890-4917-8ce3-dd59989be8b0 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:41.138166 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-785ee83d-7c45-4364-aa98-327392849c94 req-26dd228f-f9c3-4c87-a438-385f51b679ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6abd4e9-f5fd-4413-9d26-808c47d618ab", "tag": "889c7cd8-c299-4d1a-a392-db09b20c9d47"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:22:41.213850 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-785ee83d-7c45-4364-aa98-327392849c94 req-26dd228f-f9c3-4c87-a438-385f51b679ca service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:41.215032 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-785ee83d-7c45-4364-aa98-327392849c94 req-26dd228f-f9c3-4c87-a438-385f51b679ca service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:41.256211 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-785ee83d-7c45-4364-aa98-327392849c94 req-26dd228f-f9c3-4c87-a438-385f51b679ca service nova] Creating event network-changed:889c7cd8-c299-4d1a-a392-db09b20c9d47 for instance e6abd4e9-f5fd-4413-9d26-808c47d618ab on hv-cinder-83608 May 10 21:22:41.268905 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-785ee83d-7c45-4364-aa98-327392849c94 req-26dd228f-f9c3-4c87-a438-385f51b679ca service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154662 May 10 21:22:41.270422 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 173/325] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:22:41.364833 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-d6fde0a4-1c07-4f3d-84c7-15b67dd3ea75 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:41.365400 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-d6fde0a4-1c07-4f3d-84c7-15b67dd3ea75 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:41.397840 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d6fde0a4-1c07-4f3d-84c7-15b67dd3ea75 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:41.400651 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d6fde0a4-1c07-4f3d-84c7-15b67dd3ea75 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:41.403440 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d6fde0a4-1c07-4f3d-84c7-15b67dd3ea75 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:41.404650 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d6fde0a4-1c07-4f3d-84c7-15b67dd3ea75 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:41.605665 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-a9b46077-c890-4917-8ce3-dd59989be8b0 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:41.618261 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-a9b46077-c890-4917-8ce3-dd59989be8b0 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:41.620110 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-a9b46077-c890-4917-8ce3-dd59989be8b0 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:41.628162 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-a9b46077-c890-4917-8ce3-dd59989be8b0 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1739 microversion: 2.20 time: 0.570138 May 10 21:22:41.628972 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 153/326] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:22:41 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1739 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:22:41.745578 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-d6fde0a4-1c07-4f3d-84c7-15b67dd3ea75 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:41.752748 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-d6fde0a4-1c07-4f3d-84c7-15b67dd3ea75 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1371 microversion: 2.1 time: 0.395089 May 10 21:22:41.755804 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 174/327] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:41 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1371 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:41.775907 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-43e2ed46-55c7-44d0-8c61-de2c4236a6ab tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:41.777181 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-43e2ed46-55c7-44d0-8c61-de2c4236a6ab tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:41.785517 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-43e2ed46-55c7-44d0-8c61-de2c4236a6ab tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:41.786500 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-43e2ed46-55c7-44d0-8c61-de2c4236a6ab tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:41.788253 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-43e2ed46-55c7-44d0-8c61-de2c4236a6ab tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:41.789127 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-43e2ed46-55c7-44d0-8c61-de2c4236a6ab tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:42.189988 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-43e2ed46-55c7-44d0-8c61-de2c4236a6ab tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:42.220327 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-43e2ed46-55c7-44d0-8c61-de2c4236a6ab tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1720 microversion: 2.1 time: 0.433719 May 10 21:22:42.225493 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 154/328] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:41 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1720 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:42.648344 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-7552b8fc-f57e-4991-9bdc-bc2c9ad26ec1 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:42.649275 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-7552b8fc-f57e-4991-9bdc-bc2c9ad26ec1 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:42.661931 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7552b8fc-f57e-4991-9bdc-bc2c9ad26ec1 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:42.667054 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7552b8fc-f57e-4991-9bdc-bc2c9ad26ec1 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:42.667904 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7552b8fc-f57e-4991-9bdc-bc2c9ad26ec1 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:42.669523 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7552b8fc-f57e-4991-9bdc-bc2c9ad26ec1 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:42.779549 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-0bb4e4e3-ca36-46cd-bee3-a053665ed514 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:42.780399 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-0bb4e4e3-ca36-46cd-bee3-a053665ed514 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:42.799560 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0bb4e4e3-ca36-46cd-bee3-a053665ed514 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:42.804513 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0bb4e4e3-ca36-46cd-bee3-a053665ed514 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:42.805596 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0bb4e4e3-ca36-46cd-bee3-a053665ed514 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:42.806238 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0bb4e4e3-ca36-46cd-bee3-a053665ed514 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:43.036952 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-7552b8fc-f57e-4991-9bdc-bc2c9ad26ec1 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:43.050828 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-7552b8fc-f57e-4991-9bdc-bc2c9ad26ec1 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:43.056193 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-7552b8fc-f57e-4991-9bdc-bc2c9ad26ec1 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:43.058267 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-0bb4e4e3-ca36-46cd-bee3-a053665ed514 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:43.063690 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-7552b8fc-f57e-4991-9bdc-bc2c9ad26ec1 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1739 microversion: 2.20 time: 0.416410 May 10 21:22:43.064776 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 175/329] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:22:42 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1739 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:22:43.079321 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-0bb4e4e3-ca36-46cd-bee3-a053665ed514 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1371 microversion: 2.1 time: 0.304850 May 10 21:22:43.088650 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 155/330] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:42 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1371 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:43.238819 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-210c9729-1991-4f8a-bc24-20342cf105c1 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:43.239769 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-210c9729-1991-4f8a-bc24-20342cf105c1 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:43.250782 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-210c9729-1991-4f8a-bc24-20342cf105c1 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:43.256001 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-210c9729-1991-4f8a-bc24-20342cf105c1 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:43.262165 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-210c9729-1991-4f8a-bc24-20342cf105c1 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:43.262165 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-210c9729-1991-4f8a-bc24-20342cf105c1 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:43.601961 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-210c9729-1991-4f8a-bc24-20342cf105c1 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:43.611719 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-210c9729-1991-4f8a-bc24-20342cf105c1 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1720 microversion: 2.1 time: 0.378019 May 10 21:22:43.616476 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 176/331] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:43 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1720 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:44.082930 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-9f6214d5-4faf-4312-949b-62a64c4bf066 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:44.083532 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-9f6214d5-4faf-4312-949b-62a64c4bf066 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:44.094162 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9f6214d5-4faf-4312-949b-62a64c4bf066 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:44.094645 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9f6214d5-4faf-4312-949b-62a64c4bf066 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:44.095421 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9f6214d5-4faf-4312-949b-62a64c4bf066 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:44.095847 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9f6214d5-4faf-4312-949b-62a64c4bf066 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:44.103239 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-0eecda01-8bb4-47aa-a064-bf622b29da14 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:44.105794 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-0eecda01-8bb4-47aa-a064-bf622b29da14 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:44.112949 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0eecda01-8bb4-47aa-a064-bf622b29da14 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:44.113645 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0eecda01-8bb4-47aa-a064-bf622b29da14 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:44.115858 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0eecda01-8bb4-47aa-a064-bf622b29da14 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:44.116606 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0eecda01-8bb4-47aa-a064-bf622b29da14 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:44.328432 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-0eecda01-8bb4-47aa-a064-bf622b29da14 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:44.338931 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-0eecda01-8bb4-47aa-a064-bf622b29da14 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1371 microversion: 2.1 time: 0.243388 May 10 21:22:44.340220 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 177/332] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:44 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1371 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:44.489119 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-9f6214d5-4faf-4312-949b-62a64c4bf066 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:44.515273 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-9f6214d5-4faf-4312-949b-62a64c4bf066 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:44.517809 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-9f6214d5-4faf-4312-949b-62a64c4bf066 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:44.519458 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-9f6214d5-4faf-4312-949b-62a64c4bf066 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1739 microversion: 2.20 time: 0.440409 May 10 21:22:44.520225 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 156/333] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:22:44 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1739 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:22:44.643498 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-d3689b59-ebd2-42f2-a3c9-2646a8786cad tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:44.644697 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-d3689b59-ebd2-42f2-a3c9-2646a8786cad tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:44.656438 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d3689b59-ebd2-42f2-a3c9-2646a8786cad tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:44.658694 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d3689b59-ebd2-42f2-a3c9-2646a8786cad tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:44.660219 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d3689b59-ebd2-42f2-a3c9-2646a8786cad tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:44.660676 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d3689b59-ebd2-42f2-a3c9-2646a8786cad tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:44.907974 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-d3689b59-ebd2-42f2-a3c9-2646a8786cad tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:44.927797 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-d3689b59-ebd2-42f2-a3c9-2646a8786cad tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1720 microversion: 2.1 time: 0.292043 May 10 21:22:44.928979 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 178/334] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:44 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1720 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:45.356893 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-510f41cf-6da0-47cb-b32e-3cef4f76ecbd tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:45.358624 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-510f41cf-6da0-47cb-b32e-3cef4f76ecbd tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:45.366666 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-510f41cf-6da0-47cb-b32e-3cef4f76ecbd tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:45.367560 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-510f41cf-6da0-47cb-b32e-3cef4f76ecbd tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:45.374563 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-510f41cf-6da0-47cb-b32e-3cef4f76ecbd tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:45.375767 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-510f41cf-6da0-47cb-b32e-3cef4f76ecbd tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:45.538382 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-9d5ca39a-189a-4944-9c9f-668760369b6c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:45.539240 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-9d5ca39a-189a-4944-9c9f-668760369b6c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:45.545935 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9d5ca39a-189a-4944-9c9f-668760369b6c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:45.546384 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9d5ca39a-189a-4944-9c9f-668760369b6c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:45.547186 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9d5ca39a-189a-4944-9c9f-668760369b6c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:45.547617 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9d5ca39a-189a-4944-9c9f-668760369b6c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:45.621681 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-510f41cf-6da0-47cb-b32e-3cef4f76ecbd tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:45.630744 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-510f41cf-6da0-47cb-b32e-3cef4f76ecbd tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1371 microversion: 2.1 time: 0.277704 May 10 21:22:45.642877 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 157/335] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:45 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1371 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:45.695545 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-9d5ca39a-189a-4944-9c9f-668760369b6c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:45.704357 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-9d5ca39a-189a-4944-9c9f-668760369b6c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:45.705930 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-9d5ca39a-189a-4944-9c9f-668760369b6c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:45.707315 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-9d5ca39a-189a-4944-9c9f-668760369b6c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1739 microversion: 2.20 time: 0.172801 May 10 21:22:45.707894 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 179/336] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:22:45 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:22:45.947660 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-69bb0783-4482-4dce-a38e-3eaa5427d658 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:45.948188 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-69bb0783-4482-4dce-a38e-3eaa5427d658 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:45.955022 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-69bb0783-4482-4dce-a38e-3eaa5427d658 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:45.955543 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-69bb0783-4482-4dce-a38e-3eaa5427d658 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:45.956329 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-69bb0783-4482-4dce-a38e-3eaa5427d658 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:45.956769 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-69bb0783-4482-4dce-a38e-3eaa5427d658 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:46.127294 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-69bb0783-4482-4dce-a38e-3eaa5427d658 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:46.143132 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-69bb0783-4482-4dce-a38e-3eaa5427d658 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1720 microversion: 2.1 time: 0.198961 May 10 21:22:46.144039 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 158/337] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:45 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1720 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:46.273326 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-5e04b53a-c944-43e3-b8cc-085951cab9e2 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-557933264", "imageRef": "2d72b3e0-7d02-481e-b5e6-17f44e8729d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3f280d19-4e21-4706-a61f-7c29f950ac00"}], "security_groups": [{"name": "tempest-securitygroup--374033184"}], "key_name": "tempest-keypair-1009693388", "user_data": "}} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:22:46.648841 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-991a35d0-02b9-4622-85bd-bee977cbc2da tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:46.649449 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-991a35d0-02b9-4622-85bd-bee977cbc2da tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:46.658994 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-991a35d0-02b9-4622-85bd-bee977cbc2da tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:46.659636 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-991a35d0-02b9-4622-85bd-bee977cbc2da tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:46.660769 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-991a35d0-02b9-4622-85bd-bee977cbc2da tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:46.661351 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-991a35d0-02b9-4622-85bd-bee977cbc2da tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:46.934111 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-991a35d0-02b9-4622-85bd-bee977cbc2da tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:46.944391 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-991a35d0-02b9-4622-85bd-bee977cbc2da tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1371 microversion: 2.1 time: 0.299169 May 10 21:22:46.945306 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 159/338] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:46 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1371 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:22:46.950021 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-e0ab1a95-b8bf-4dd9-89ab-6402f1d0efef req-2f59c4bb-7eae-4dd2-a591-21bf15f3a782 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6abd4e9-f5fd-4413-9d26-808c47d618ab", "name": "network-vif-plugged", "status": "completed", "tag": "889c7cd8-c299-4d1a-a392-db09b20c9d47"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:22:46.962554 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-e0ab1a95-b8bf-4dd9-89ab-6402f1d0efef req-2f59c4bb-7eae-4dd2-a591-21bf15f3a782 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:46.962554 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-e0ab1a95-b8bf-4dd9-89ab-6402f1d0efef req-2f59c4bb-7eae-4dd2-a591-21bf15f3a782 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:46.978526 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-e0ab1a95-b8bf-4dd9-89ab-6402f1d0efef req-2f59c4bb-7eae-4dd2-a591-21bf15f3a782 service nova] Creating event network-vif-plugged:889c7cd8-c299-4d1a-a392-db09b20c9d47 for instance e6abd4e9-f5fd-4413-9d26-808c47d618ab on hv-cinder-83608 May 10 21:22:47.000208 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-e0ab1a95-b8bf-4dd9-89ab-6402f1d0efef req-2f59c4bb-7eae-4dd2-a591-21bf15f3a782 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053620 May 10 21:22:47.001143 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 160/339] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:22:47.007430 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-3793ee0c-f20e-4722-ab8d-7b6ea5c90590 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:47.008269 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-3793ee0c-f20e-4722-ab8d-7b6ea5c90590 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:47.022149 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3793ee0c-f20e-4722-ab8d-7b6ea5c90590 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:47.022149 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3793ee0c-f20e-4722-ab8d-7b6ea5c90590 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:47.022149 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3793ee0c-f20e-4722-ab8d-7b6ea5c90590 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:47.022149 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3793ee0c-f20e-4722-ab8d-7b6ea5c90590 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:47.231400 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-3793ee0c-f20e-4722-ab8d-7b6ea5c90590 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:47.237609 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-3793ee0c-f20e-4722-ab8d-7b6ea5c90590 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:47.241027 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-3793ee0c-f20e-4722-ab8d-7b6ea5c90590 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:47.242389 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-3793ee0c-f20e-4722-ab8d-7b6ea5c90590 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1739 microversion: 2.20 time: 0.239970 May 10 21:22:47.256246 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 161/340] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:22:47 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1739 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:22:47.261481 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e615d74a-f209-402b-a56f-5f806bc0059f tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:47.262616 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-e615d74a-f209-402b-a56f-5f806bc0059f tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:47.272957 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e615d74a-f209-402b-a56f-5f806bc0059f tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:47.273404 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e615d74a-f209-402b-a56f-5f806bc0059f tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:47.274189 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e615d74a-f209-402b-a56f-5f806bc0059f tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:47.274664 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e615d74a-f209-402b-a56f-5f806bc0059f tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:47.548178 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-e615d74a-f209-402b-a56f-5f806bc0059f tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:47.562123 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-e615d74a-f209-402b-a56f-5f806bc0059f tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1720 microversion: 2.1 time: 0.304393 May 10 21:22:47.562984 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 162/341] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:47 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1720 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:47.961494 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-39b9360e-06ab-4a78-afc8-464b7c3d52a2 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:47.962949 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-39b9360e-06ab-4a78-afc8-464b7c3d52a2 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:47.970869 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-39b9360e-06ab-4a78-afc8-464b7c3d52a2 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:47.972010 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-39b9360e-06ab-4a78-afc8-464b7c3d52a2 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:47.972911 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-39b9360e-06ab-4a78-afc8-464b7c3d52a2 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:47.973564 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-39b9360e-06ab-4a78-afc8-464b7c3d52a2 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:48.148214 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-39b9360e-06ab-4a78-afc8-464b7c3d52a2 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:48.161690 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-39b9360e-06ab-4a78-afc8-464b7c3d52a2 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1371 microversion: 2.1 time: 0.204206 May 10 21:22:48.162299 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 163/342] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:47 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1371 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:48.267785 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-b50ebe35-4e18-45f1-92c9-ae7112ce9ce6 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:48.267785 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-b50ebe35-4e18-45f1-92c9-ae7112ce9ce6 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:48.273912 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b50ebe35-4e18-45f1-92c9-ae7112ce9ce6 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:48.274537 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b50ebe35-4e18-45f1-92c9-ae7112ce9ce6 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:48.275821 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b50ebe35-4e18-45f1-92c9-ae7112ce9ce6 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:48.276471 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b50ebe35-4e18-45f1-92c9-ae7112ce9ce6 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:48.505340 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b50ebe35-4e18-45f1-92c9-ae7112ce9ce6 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:48.522481 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b50ebe35-4e18-45f1-92c9-ae7112ce9ce6 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:48.524097 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b50ebe35-4e18-45f1-92c9-ae7112ce9ce6 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:48.525377 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-b50ebe35-4e18-45f1-92c9-ae7112ce9ce6 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1739 microversion: 2.20 time: 0.266867 May 10 21:22:48.526048 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 164/343] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:22:48 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1739 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:22:48.583870 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-b9f47047-e7ff-4561-9b65-ee9750c98b6b tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:48.590191 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-b9f47047-e7ff-4561-9b65-ee9750c98b6b tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:48.609545 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b9f47047-e7ff-4561-9b65-ee9750c98b6b tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:48.610733 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b9f47047-e7ff-4561-9b65-ee9750c98b6b tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:48.612718 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b9f47047-e7ff-4561-9b65-ee9750c98b6b tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:48.615243 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b9f47047-e7ff-4561-9b65-ee9750c98b6b tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:48.823081 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b9f47047-e7ff-4561-9b65-ee9750c98b6b tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:48.832335 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-b9f47047-e7ff-4561-9b65-ee9750c98b6b tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1720 microversion: 2.1 time: 0.252528 May 10 21:22:48.833117 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 165/344] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:48 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1720 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:49.181702 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-ba178965-3f0d-4adf-8117-f3554fc7be7d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:49.189571 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-ba178965-3f0d-4adf-8117-f3554fc7be7d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:49.203528 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ba178965-3f0d-4adf-8117-f3554fc7be7d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:49.203989 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ba178965-3f0d-4adf-8117-f3554fc7be7d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:49.206073 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ba178965-3f0d-4adf-8117-f3554fc7be7d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:49.206724 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ba178965-3f0d-4adf-8117-f3554fc7be7d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:49.452505 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-ba178965-3f0d-4adf-8117-f3554fc7be7d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:49.464849 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-ba178965-3f0d-4adf-8117-f3554fc7be7d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1565 microversion: 2.1 time: 0.287951 May 10 21:22:49.478094 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 166/345] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:49 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1565 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:22:49.507815 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-751af31e-eb7e-4232-ab22-3620fc2dcf50 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:49.508663 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-751af31e-eb7e-4232-ab22-3620fc2dcf50 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:49.516658 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-751af31e-eb7e-4232-ab22-3620fc2dcf50 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:49.517313 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-751af31e-eb7e-4232-ab22-3620fc2dcf50 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:49.518406 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-751af31e-eb7e-4232-ab22-3620fc2dcf50 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:49.519023 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-751af31e-eb7e-4232-ab22-3620fc2dcf50 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:49.664948 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-751af31e-eb7e-4232-ab22-3620fc2dcf50 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.185582 May 10 21:22:49.674234 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 167/346] 10.222.0.25 () {58 vars in 1274 bytes} [Tue May 10 21:22:49 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab/os-interface => generated 284 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:22:49.679423 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e9243b09-a405-4044-836b-1280f728a013 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:49.680040 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-e9243b09-a405-4044-836b-1280f728a013 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:49.688240 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e9243b09-a405-4044-836b-1280f728a013 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:49.688695 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e9243b09-a405-4044-836b-1280f728a013 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:49.689470 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e9243b09-a405-4044-836b-1280f728a013 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:49.689901 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e9243b09-a405-4044-836b-1280f728a013 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:49.905695 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-e9243b09-a405-4044-836b-1280f728a013 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:49.916728 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-e9243b09-a405-4044-836b-1280f728a013 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:49.918747 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-e9243b09-a405-4044-836b-1280f728a013 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:49.921294 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-e9243b09-a405-4044-836b-1280f728a013 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1739 microversion: 2.20 time: 0.245222 May 10 21:22:49.932717 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 168/347] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:22:49 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1739 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:22:49.941292 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-dbee0747-dabc-4420-91e7-b6b0369f69c7 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:49.942089 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-dbee0747-dabc-4420-91e7-b6b0369f69c7 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:49.950665 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dbee0747-dabc-4420-91e7-b6b0369f69c7 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:49.951965 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dbee0747-dabc-4420-91e7-b6b0369f69c7 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:49.953741 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dbee0747-dabc-4420-91e7-b6b0369f69c7 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:49.954782 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dbee0747-dabc-4420-91e7-b6b0369f69c7 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:50.177840 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-dbee0747-dabc-4420-91e7-b6b0369f69c7 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:50.185683 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-dbee0747-dabc-4420-91e7-b6b0369f69c7 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1720 microversion: 2.1 time: 0.253129 May 10 21:22:50.186252 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 169/348] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:49 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1720 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:50.941126 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-b4e4fbb8-4bce-4567-8b0e-f8f248b96b88 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:50.947041 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-b4e4fbb8-4bce-4567-8b0e-f8f248b96b88 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:50.964319 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b4e4fbb8-4bce-4567-8b0e-f8f248b96b88 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:50.965073 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b4e4fbb8-4bce-4567-8b0e-f8f248b96b88 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:50.965885 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b4e4fbb8-4bce-4567-8b0e-f8f248b96b88 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:50.966324 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b4e4fbb8-4bce-4567-8b0e-f8f248b96b88 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:51.223786 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b4e4fbb8-4bce-4567-8b0e-f8f248b96b88 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:51.246065 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b4e4fbb8-4bce-4567-8b0e-f8f248b96b88 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:51.248162 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b4e4fbb8-4bce-4567-8b0e-f8f248b96b88 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:51.249892 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-b4e4fbb8-4bce-4567-8b0e-f8f248b96b88 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1739 microversion: 2.20 time: 0.313470 May 10 21:22:51.252047 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 170/349] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:22:50 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1739 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:22:51.258059 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-f311f055-bf37-4617-b914-360d6c49761e tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:51.259234 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-f311f055-bf37-4617-b914-360d6c49761e tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:51.273122 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f311f055-bf37-4617-b914-360d6c49761e tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:51.273571 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f311f055-bf37-4617-b914-360d6c49761e tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:51.278126 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f311f055-bf37-4617-b914-360d6c49761e tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:51.279108 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f311f055-bf37-4617-b914-360d6c49761e tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:51.538701 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-f311f055-bf37-4617-b914-360d6c49761e tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:51.562685 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-f311f055-bf37-4617-b914-360d6c49761e tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1720 microversion: 2.1 time: 0.308998 May 10 21:22:51.565617 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 171/350] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:51 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1720 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:51.586818 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-707d56c9-b14b-425f-93af-f41e890ebaed req-9c58f2ed-1bd0-4792-aab9-3e02f538922f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6abd4e9-f5fd-4413-9d26-808c47d618ab", "tag": "889c7cd8-c299-4d1a-a392-db09b20c9d47"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:22:51.613873 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-707d56c9-b14b-425f-93af-f41e890ebaed req-9c58f2ed-1bd0-4792-aab9-3e02f538922f service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:51.616051 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-707d56c9-b14b-425f-93af-f41e890ebaed req-9c58f2ed-1bd0-4792-aab9-3e02f538922f service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:51.649193 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-707d56c9-b14b-425f-93af-f41e890ebaed req-9c58f2ed-1bd0-4792-aab9-3e02f538922f service nova] Creating event network-changed:889c7cd8-c299-4d1a-a392-db09b20c9d47 for instance e6abd4e9-f5fd-4413-9d26-808c47d618ab on hv-cinder-83608 May 10 21:22:51.658233 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-707d56c9-b14b-425f-93af-f41e890ebaed req-9c58f2ed-1bd0-4792-aab9-3e02f538922f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081606 May 10 21:22:51.665733 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 172/351] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:22:52.270896 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-9a149e12-07a0-487f-bd46-884ec65f520a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:52.272306 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-9a149e12-07a0-487f-bd46-884ec65f520a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:52.279886 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9a149e12-07a0-487f-bd46-884ec65f520a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:52.280601 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9a149e12-07a0-487f-bd46-884ec65f520a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:52.281638 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9a149e12-07a0-487f-bd46-884ec65f520a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:52.282583 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9a149e12-07a0-487f-bd46-884ec65f520a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:52.628399 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-9a149e12-07a0-487f-bd46-884ec65f520a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:52.638930 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-9a149e12-07a0-487f-bd46-884ec65f520a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:52.646839 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-9a149e12-07a0-487f-bd46-884ec65f520a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:52.648834 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-9a149e12-07a0-487f-bd46-884ec65f520a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1739 microversion: 2.20 time: 0.382469 May 10 21:22:52.661975 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 173/352] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:22:52 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1739 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:22:52.662642 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-c5570d7d-4f49-47d2-94d8-198a4da87de9 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:52.663382 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-c5570d7d-4f49-47d2-94d8-198a4da87de9 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:52.688041 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c5570d7d-4f49-47d2-94d8-198a4da87de9 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:52.696991 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c5570d7d-4f49-47d2-94d8-198a4da87de9 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:52.699691 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c5570d7d-4f49-47d2-94d8-198a4da87de9 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:52.703946 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.network.neutron [None req-5e04b53a-c944-43e3-b8cc-085951cab9e2 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] validate_networks() for [('3f280d19-4e21-4706-a61f-7c29f950ac00', None, None, None, None, None)] {{(pid=117678) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 21:22:52.711973 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c5570d7d-4f49-47d2-94d8-198a4da87de9 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:53.020588 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-c5570d7d-4f49-47d2-94d8-198a4da87de9 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:53.032266 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-c5570d7d-4f49-47d2-94d8-198a4da87de9 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1720 microversion: 2.1 time: 0.377443 May 10 21:22:53.033407 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 174/353] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:52 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1720 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:53.477127 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-5e04b53a-c944-43e3-b8cc-085951cab9e2 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Flavor limits 0:0:0 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 21:22:53.478166 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-5e04b53a-c944-43e3-b8cc-085951cab9e2 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Image limits 0:0:0 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 21:22:53.478745 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-5e04b53a-c944-43e3-b8cc-085951cab9e2 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Flavor pref 0:0:0 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 21:22:53.482887 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-5e04b53a-c944-43e3-b8cc-085951cab9e2 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Image pref 0:0:0 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 21:22:53.482887 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-5e04b53a-c944-43e3-b8cc-085951cab9e2 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 21:22:53.495573 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5e04b53a-c944-43e3-b8cc-085951cab9e2 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:53.496344 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5e04b53a-c944-43e3-b8cc-085951cab9e2 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:53.497361 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5e04b53a-c944-43e3-b8cc-085951cab9e2 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:53.498147 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5e04b53a-c944-43e3-b8cc-085951cab9e2 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:53.523924 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.quota [None req-5e04b53a-c944-43e3-b8cc-085951cab9e2 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Getting quotas for project 8286226c580f4896aec72c65642fce30. Resources: {'cores', 'instances', 'ram'} {{(pid=117678) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:22:53.533537 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.quota [None req-5e04b53a-c944-43e3-b8cc-085951cab9e2 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Getting quotas for user ca39678abe6e476283f94c675d4ea369 and project 8286226c580f4896aec72c65642fce30. Resources: {'cores', 'instances', 'ram'} {{(pid=117678) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:22:53.559099 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-5e04b53a-c944-43e3-b8cc-085951cab9e2 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Going to run 1 instances... {{(pid=117678) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 21:22:53.564393 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-5e04b53a-c944-43e3-b8cc-085951cab9e2 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 362a9924-7119-4e2e-bd41-d68a5f545009] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d72b3e0-7d02-481e-b5e6-17f44e8729d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 21:22:53.670892 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-1e7e323a-e44b-47d0-b849-89d601fe82cd tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:53.671503 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-1e7e323a-e44b-47d0-b849-89d601fe82cd tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:53.679597 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1e7e323a-e44b-47d0-b849-89d601fe82cd tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:53.680278 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1e7e323a-e44b-47d0-b849-89d601fe82cd tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:53.682190 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1e7e323a-e44b-47d0-b849-89d601fe82cd tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:53.682854 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1e7e323a-e44b-47d0-b849-89d601fe82cd tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:53.708923 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-5e04b53a-c944-43e3-b8cc-085951cab9e2 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 7.439781 May 10 21:22:53.714280 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 180/354] 10.222.0.25 () {60 vars in 1146 bytes} [Tue May 10 21:22:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 7446 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 21:22:53.726321 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-bfa43472-4d2f-4152-8ebb-66d49d81db2d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:53.729611 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-bfa43472-4d2f-4152-8ebb-66d49d81db2d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 362a9924-7119-4e2e-bd41-d68a5f545009] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:53.892385 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-bfa43472-4d2f-4152-8ebb-66d49d81db2d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:53.901819 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-bfa43472-4d2f-4152-8ebb-66d49d81db2d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009" status: 200 len: 1241 microversion: 2.1 time: 0.180837 May 10 21:22:53.912699 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 181/355] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:53 2022] GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009 => generated 1241 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:22:54.005031 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1e7e323a-e44b-47d0-b849-89d601fe82cd tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:54.018542 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1e7e323a-e44b-47d0-b849-89d601fe82cd tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:54.024022 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1e7e323a-e44b-47d0-b849-89d601fe82cd tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:54.025478 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-1e7e323a-e44b-47d0-b849-89d601fe82cd tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1721 microversion: 2.20 time: 0.360619 May 10 21:22:54.028747 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 175/356] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:22:53 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1721 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:22:54.050531 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-d56b5ab7-c1b2-46b0-be7b-aa616422dcba tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:54.051148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-d56b5ab7-c1b2-46b0-be7b-aa616422dcba tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:54.061848 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d56b5ab7-c1b2-46b0-be7b-aa616422dcba tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:54.062229 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d56b5ab7-c1b2-46b0-be7b-aa616422dcba tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:54.063079 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d56b5ab7-c1b2-46b0-be7b-aa616422dcba tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:54.063505 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d56b5ab7-c1b2-46b0-be7b-aa616422dcba tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:54.386660 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-d56b5ab7-c1b2-46b0-be7b-aa616422dcba tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:54.399637 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-d56b5ab7-c1b2-46b0-be7b-aa616422dcba tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1720 microversion: 2.1 time: 0.354296 May 10 21:22:54.400385 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 182/357] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:54 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1720 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:54.922734 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-ad555b28-ddf6-4f05-bbed-6f423cfdaeea tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:54.924128 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-ad555b28-ddf6-4f05-bbed-6f423cfdaeea tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 362a9924-7119-4e2e-bd41-d68a5f545009] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:54.931039 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ad555b28-ddf6-4f05-bbed-6f423cfdaeea tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:54.931775 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ad555b28-ddf6-4f05-bbed-6f423cfdaeea tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:54.932979 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ad555b28-ddf6-4f05-bbed-6f423cfdaeea tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:54.933752 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ad555b28-ddf6-4f05-bbed-6f423cfdaeea tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:55.007963 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-ad555b28-ddf6-4f05-bbed-6f423cfdaeea tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:55.018886 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-ad555b28-ddf6-4f05-bbed-6f423cfdaeea tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009" status: 200 len: 1245 microversion: 2.1 time: 0.102987 May 10 21:22:55.019595 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 176/358] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:54 2022] GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009 => generated 1245 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:55.047609 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-e861952a-43af-47b7-936e-0241a2c3826d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:55.048361 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-e861952a-43af-47b7-936e-0241a2c3826d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:55.054202 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e861952a-43af-47b7-936e-0241a2c3826d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:55.054809 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e861952a-43af-47b7-936e-0241a2c3826d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:55.055584 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e861952a-43af-47b7-936e-0241a2c3826d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:55.055998 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e861952a-43af-47b7-936e-0241a2c3826d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:55.217495 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-e861952a-43af-47b7-936e-0241a2c3826d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:55.226082 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-e861952a-43af-47b7-936e-0241a2c3826d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:55.227880 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-e861952a-43af-47b7-936e-0241a2c3826d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:55.241269 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-e861952a-43af-47b7-936e-0241a2c3826d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1721 microversion: 2.20 time: 0.186067 May 10 21:22:55.241269 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 183/359] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:22:55 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:22:55.416899 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-74abffc0-bbed-4d1b-88ec-bd33c3e1aea0 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:55.417503 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-74abffc0-bbed-4d1b-88ec-bd33c3e1aea0 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:55.424143 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-74abffc0-bbed-4d1b-88ec-bd33c3e1aea0 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:55.424766 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-74abffc0-bbed-4d1b-88ec-bd33c3e1aea0 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:55.425688 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-74abffc0-bbed-4d1b-88ec-bd33c3e1aea0 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:55.426263 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-74abffc0-bbed-4d1b-88ec-bd33c3e1aea0 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:55.841096 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-74abffc0-bbed-4d1b-88ec-bd33c3e1aea0 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:55.850247 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-74abffc0-bbed-4d1b-88ec-bd33c3e1aea0 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1720 microversion: 2.1 time: 0.437114 May 10 21:22:55.851338 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 177/360] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:55 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1720 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:56.043695 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-db2bb29f-1ca4-4f75-9c63-abf0e9acfcea tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:56.044429 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-db2bb29f-1ca4-4f75-9c63-abf0e9acfcea tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 362a9924-7119-4e2e-bd41-d68a5f545009] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:56.051306 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-db2bb29f-1ca4-4f75-9c63-abf0e9acfcea tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:56.051885 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-db2bb29f-1ca4-4f75-9c63-abf0e9acfcea tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:56.052719 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-db2bb29f-1ca4-4f75-9c63-abf0e9acfcea tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:56.053252 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-db2bb29f-1ca4-4f75-9c63-abf0e9acfcea tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:56.125480 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-db2bb29f-1ca4-4f75-9c63-abf0e9acfcea tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:56.144344 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-db2bb29f-1ca4-4f75-9c63-abf0e9acfcea tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009" status: 200 len: 1245 microversion: 2.1 time: 0.096455 May 10 21:22:56.144344 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 184/361] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:56 2022] GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009 => generated 1245 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:56.249797 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-8adfabb5-37ef-49d3-a984-81ce89c5cb75 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:56.251028 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-8adfabb5-37ef-49d3-a984-81ce89c5cb75 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:56.257967 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8adfabb5-37ef-49d3-a984-81ce89c5cb75 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:56.258411 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8adfabb5-37ef-49d3-a984-81ce89c5cb75 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:56.259236 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8adfabb5-37ef-49d3-a984-81ce89c5cb75 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:56.259676 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8adfabb5-37ef-49d3-a984-81ce89c5cb75 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:56.534080 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-0a01047e-2530-4b3a-a515-fc9de7dffcc2 req-00ae81b5-37c7-41f3-8889-842f7374daac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef19cfc2-aeb2-40ff-b25c-187304690869", "name": "network-vif-unplugged", "status": "completed", "tag": "83ef924d-2caa-4d5a-8fb2-cd0a871c9712"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:22:56.552201 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-0a01047e-2530-4b3a-a515-fc9de7dffcc2 req-00ae81b5-37c7-41f3-8889-842f7374daac service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:56.553005 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-0a01047e-2530-4b3a-a515-fc9de7dffcc2 req-00ae81b5-37c7-41f3-8889-842f7374daac service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:56.572321 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-0a01047e-2530-4b3a-a515-fc9de7dffcc2 req-00ae81b5-37c7-41f3-8889-842f7374daac service nova] Creating event network-vif-unplugged:83ef924d-2caa-4d5a-8fb2-cd0a871c9712 for instance ef19cfc2-aeb2-40ff-b25c-187304690869 on hv-cinder-83608 May 10 21:22:56.579368 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-0a01047e-2530-4b3a-a515-fc9de7dffcc2 req-00ae81b5-37c7-41f3-8889-842f7374daac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065005 May 10 21:22:56.580327 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 185/362] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:22:56.583466 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8adfabb5-37ef-49d3-a984-81ce89c5cb75 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:56.598490 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8adfabb5-37ef-49d3-a984-81ce89c5cb75 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:56.601416 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8adfabb5-37ef-49d3-a984-81ce89c5cb75 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:56.603781 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-8adfabb5-37ef-49d3-a984-81ce89c5cb75 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1721 microversion: 2.20 time: 0.358819 May 10 21:22:56.606208 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 178/363] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:22:56 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1721 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:22:56.877059 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-44da560a-1c51-48f8-8190-4c32abcf477d tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:56.883213 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-44da560a-1c51-48f8-8190-4c32abcf477d tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:56.904374 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-44da560a-1c51-48f8-8190-4c32abcf477d tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:56.904928 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-44da560a-1c51-48f8-8190-4c32abcf477d tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:56.908900 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-44da560a-1c51-48f8-8190-4c32abcf477d tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:56.909541 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-44da560a-1c51-48f8-8190-4c32abcf477d tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:57.127512 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-44da560a-1c51-48f8-8190-4c32abcf477d tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:57.127512 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-44da560a-1c51-48f8-8190-4c32abcf477d tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1720 microversion: 2.1 time: 0.259449 May 10 21:22:57.127512 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 186/364] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:56 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1720 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:57.165978 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-830a5548-6296-4d8b-a88c-8d9181c2c976 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:57.166677 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-830a5548-6296-4d8b-a88c-8d9181c2c976 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 362a9924-7119-4e2e-bd41-d68a5f545009] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:57.178784 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-830a5548-6296-4d8b-a88c-8d9181c2c976 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:57.179414 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-830a5548-6296-4d8b-a88c-8d9181c2c976 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:57.186370 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-830a5548-6296-4d8b-a88c-8d9181c2c976 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:57.190010 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-830a5548-6296-4d8b-a88c-8d9181c2c976 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:57.271406 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-830a5548-6296-4d8b-a88c-8d9181c2c976 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:57.287368 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-830a5548-6296-4d8b-a88c-8d9181c2c976 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009" status: 200 len: 1293 microversion: 2.1 time: 0.136779 May 10 21:22:57.289240 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 179/365] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:57 2022] GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009 => generated 1293 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:57.623786 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-69979725-be29-4ed1-9156-708234cc71d7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:57.624583 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-69979725-be29-4ed1-9156-708234cc71d7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:57.636215 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-69979725-be29-4ed1-9156-708234cc71d7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:57.636215 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-69979725-be29-4ed1-9156-708234cc71d7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:57.636215 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-69979725-be29-4ed1-9156-708234cc71d7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:57.636215 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-69979725-be29-4ed1-9156-708234cc71d7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:57.819339 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-69979725-be29-4ed1-9156-708234cc71d7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:57.828364 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-69979725-be29-4ed1-9156-708234cc71d7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:57.830647 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-69979725-be29-4ed1-9156-708234cc71d7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:57.831557 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-69979725-be29-4ed1-9156-708234cc71d7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1664 microversion: 2.20 time: 0.212416 May 10 21:22:57.832151 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 187/366] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:22:57 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1664 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:22:57.862526 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-ebc5db74-d074-401a-aeb3-501375138390 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db60cfd4-341a-4be6-9fe6-dc5c5513580f"}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:22:57.864831 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-ebc5db74-d074-401a-aeb3-501375138390 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:57.871982 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ebc5db74-d074-401a-aeb3-501375138390 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:57.872921 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ebc5db74-d074-401a-aeb3-501375138390 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:57.874674 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ebc5db74-d074-401a-aeb3-501375138390 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:57.875270 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ebc5db74-d074-401a-aeb3-501375138390 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:58.145538 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-743f3cad-4c27-476f-9423-bc070acfe1c7 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:58.158328 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-743f3cad-4c27-476f-9423-bc070acfe1c7 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:58.166383 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-743f3cad-4c27-476f-9423-bc070acfe1c7 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:58.170844 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-743f3cad-4c27-476f-9423-bc070acfe1c7 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:58.170844 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-743f3cad-4c27-476f-9423-bc070acfe1c7 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:58.170844 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-743f3cad-4c27-476f-9423-bc070acfe1c7 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:58.352837 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-743f3cad-4c27-476f-9423-bc070acfe1c7 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:58.361094 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-743f3cad-4c27-476f-9423-bc070acfe1c7 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1720 microversion: 2.1 time: 0.220440 May 10 21:22:58.361683 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 188/367] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:58 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1720 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:22:58.366091 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-bbee37de-fb29-4271-8253-8d67c76af602 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:58.366718 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-bbee37de-fb29-4271-8253-8d67c76af602 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 362a9924-7119-4e2e-bd41-d68a5f545009] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:58.372846 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-bbee37de-fb29-4271-8253-8d67c76af602 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:58.373843 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-bbee37de-fb29-4271-8253-8d67c76af602 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:58.374655 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-bbee37de-fb29-4271-8253-8d67c76af602 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:58.375092 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-bbee37de-fb29-4271-8253-8d67c76af602 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:58.497286 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-bbee37de-fb29-4271-8253-8d67c76af602 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:58.509547 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-bbee37de-fb29-4271-8253-8d67c76af602 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009" status: 200 len: 1311 microversion: 2.1 time: 0.146818 May 10 21:22:58.510276 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 189/368] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:58 2022] GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009 => generated 1311 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:22:59.164521 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-ebc5db74-d074-401a-aeb3-501375138390 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "POST /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.317561 May 10 21:22:59.166061 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 180/369] 10.222.0.25 () {62 vars in 1363 bytes} [Tue May 10 21:22:57 2022] POST /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869/os-volume_attachments => generated 188 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:22:59.378473 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-944a876a-df04-4730-8d84-480ea10590f2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:59.379096 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-944a876a-df04-4730-8d84-480ea10590f2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:59.385968 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-944a876a-df04-4730-8d84-480ea10590f2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:59.386409 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-944a876a-df04-4730-8d84-480ea10590f2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:59.397798 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-944a876a-df04-4730-8d84-480ea10590f2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:59.397798 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-944a876a-df04-4730-8d84-480ea10590f2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:59.412505 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e03209c1-e1af-4a22-992e-b0eacacd659d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:22:59.413329 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-e03209c1-e1af-4a22-992e-b0eacacd659d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:59.424761 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e03209c1-e1af-4a22-992e-b0eacacd659d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:59.430990 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e03209c1-e1af-4a22-992e-b0eacacd659d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:59.430990 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e03209c1-e1af-4a22-992e-b0eacacd659d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:59.430990 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e03209c1-e1af-4a22-992e-b0eacacd659d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:59.617556 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-944a876a-df04-4730-8d84-480ea10590f2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:59.627213 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-944a876a-df04-4730-8d84-480ea10590f2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1720 microversion: 2.1 time: 0.252586 May 10 21:22:59.627808 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 190/370] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:59 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1720 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:22:59.643154 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-9a25e288-4e92-4cb6-a661-445b9dd20ee3 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:59.643810 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-9a25e288-4e92-4cb6-a661-445b9dd20ee3 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 362a9924-7119-4e2e-bd41-d68a5f545009] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:59.649786 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9a25e288-4e92-4cb6-a661-445b9dd20ee3 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:59.650422 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9a25e288-4e92-4cb6-a661-445b9dd20ee3 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:59.651268 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9a25e288-4e92-4cb6-a661-445b9dd20ee3 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:59.656784 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9a25e288-4e92-4cb6-a661-445b9dd20ee3 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:59.747272 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-e03209c1-e1af-4a22-992e-b0eacacd659d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "POST /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869/action" status: 202 len: 0 microversion: 2.20 time: 0.338607 May 10 21:22:59.748359 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 181/371] 10.222.0.25 () {62 vars in 1318 bytes} [Tue May 10 21:22:59 2022] POST /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 21:22:59.756257 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-86486726-502a-494e-af5c-3245cc04c33b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:22:59.757306 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-86486726-502a-494e-af5c-3245cc04c33b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:22:59.767528 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-86486726-502a-494e-af5c-3245cc04c33b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:59.768239 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-86486726-502a-494e-af5c-3245cc04c33b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:59.769223 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-86486726-502a-494e-af5c-3245cc04c33b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:22:59.769847 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-86486726-502a-494e-af5c-3245cc04c33b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:22:59.923488 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-9a25e288-4e92-4cb6-a661-445b9dd20ee3 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:22:59.935827 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-9a25e288-4e92-4cb6-a661-445b9dd20ee3 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009" status: 200 len: 1366 microversion: 2.1 time: 0.297199 May 10 21:22:59.935827 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 191/372] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:22:59 2022] GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009 => generated 1366 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:00.096711 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-86486726-502a-494e-af5c-3245cc04c33b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:00.105278 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-86486726-502a-494e-af5c-3245cc04c33b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:00.106778 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-86486726-502a-494e-af5c-3245cc04c33b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:00.110757 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-86486726-502a-494e-af5c-3245cc04c33b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1750 microversion: 2.20 time: 0.358443 May 10 21:23:00.111831 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 182/373] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:22:59 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1750 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:23:00.514134 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-2faae20a-0f45-4172-b6d1-8eef84d79610 req-98fd62eb-4072-4a29-a626-bb071853cc8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "362a9924-7119-4e2e-bd41-d68a5f545009", "tag": "d51acf48-316f-4040-b5d3-2beac72dba60"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:23:00.528354 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-2faae20a-0f45-4172-b6d1-8eef84d79610 req-98fd62eb-4072-4a29-a626-bb071853cc8e service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:00.528897 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-2faae20a-0f45-4172-b6d1-8eef84d79610 req-98fd62eb-4072-4a29-a626-bb071853cc8e service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:00.542719 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-2faae20a-0f45-4172-b6d1-8eef84d79610 req-98fd62eb-4072-4a29-a626-bb071853cc8e service nova] Creating event network-changed:d51acf48-316f-4040-b5d3-2beac72dba60 for instance 362a9924-7119-4e2e-bd41-d68a5f545009 on hv-cinder-83608 May 10 21:23:00.563664 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-2faae20a-0f45-4172-b6d1-8eef84d79610 req-98fd62eb-4072-4a29-a626-bb071853cc8e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054202 May 10 21:23:00.564735 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 192/374] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:23:00.645102 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-16b9f9da-ca96-4f6f-9e8c-7ede7758ec6c tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:00.645714 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-16b9f9da-ca96-4f6f-9e8c-7ede7758ec6c tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:00.659431 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-16b9f9da-ca96-4f6f-9e8c-7ede7758ec6c tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:00.660839 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-16b9f9da-ca96-4f6f-9e8c-7ede7758ec6c tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:00.661729 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-16b9f9da-ca96-4f6f-9e8c-7ede7758ec6c tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:00.662166 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-16b9f9da-ca96-4f6f-9e8c-7ede7758ec6c tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:00.957136 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-05fa0710-e8c3-4c72-a320-b0c2e644d82e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:00.958408 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-05fa0710-e8c3-4c72-a320-b0c2e644d82e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 362a9924-7119-4e2e-bd41-d68a5f545009] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:00.968899 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-05fa0710-e8c3-4c72-a320-b0c2e644d82e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:00.969608 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-05fa0710-e8c3-4c72-a320-b0c2e644d82e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:00.972098 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-05fa0710-e8c3-4c72-a320-b0c2e644d82e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:00.972928 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-05fa0710-e8c3-4c72-a320-b0c2e644d82e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:01.148907 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-16b9f9da-ca96-4f6f-9e8c-7ede7758ec6c tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:01.158593 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-16b9f9da-ca96-4f6f-9e8c-7ede7758ec6c tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1720 microversion: 2.1 time: 0.517596 May 10 21:23:01.159655 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 183/375] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:00 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1720 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:01.164794 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-091151e4-e304-41db-8d3c-141be7124ac3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:01.165573 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-091151e4-e304-41db-8d3c-141be7124ac3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:01.172963 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-091151e4-e304-41db-8d3c-141be7124ac3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:01.173663 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-091151e4-e304-41db-8d3c-141be7124ac3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:01.182248 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-091151e4-e304-41db-8d3c-141be7124ac3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:01.182248 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-091151e4-e304-41db-8d3c-141be7124ac3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:01.476570 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-091151e4-e304-41db-8d3c-141be7124ac3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:01.496231 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-091151e4-e304-41db-8d3c-141be7124ac3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:01.501363 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-091151e4-e304-41db-8d3c-141be7124ac3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:01.504266 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-091151e4-e304-41db-8d3c-141be7124ac3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1750 microversion: 2.20 time: 0.342662 May 10 21:23:01.507223 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 184/376] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:23:01 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1750 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:23:01.614103 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-05fa0710-e8c3-4c72-a320-b0c2e644d82e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:01.623897 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-05fa0710-e8c3-4c72-a320-b0c2e644d82e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009" status: 200 len: 1366 microversion: 2.1 time: 0.675027 May 10 21:23:01.632679 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 193/377] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:00 2022] GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009 => generated 1366 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:23:02.181496 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-2b8c0ef7-8d26-4c21-9715-016745cf8ad5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:02.183054 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-2b8c0ef7-8d26-4c21-9715-016745cf8ad5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:02.193653 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2b8c0ef7-8d26-4c21-9715-016745cf8ad5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:02.194112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2b8c0ef7-8d26-4c21-9715-016745cf8ad5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:02.195029 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2b8c0ef7-8d26-4c21-9715-016745cf8ad5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:02.195439 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2b8c0ef7-8d26-4c21-9715-016745cf8ad5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:02.399266 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2b8c0ef7-8d26-4c21-9715-016745cf8ad5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:02.410044 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-2b8c0ef7-8d26-4c21-9715-016745cf8ad5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1720 microversion: 2.1 time: 0.232892 May 10 21:23:02.410490 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 185/378] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:02 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1720 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:02.526990 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-50ae3b76-a775-435b-9932-fbf6218032bb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:02.527705 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-50ae3b76-a775-435b-9932-fbf6218032bb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:02.536215 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-50ae3b76-a775-435b-9932-fbf6218032bb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:02.536918 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-50ae3b76-a775-435b-9932-fbf6218032bb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:02.537946 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-50ae3b76-a775-435b-9932-fbf6218032bb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:02.538628 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-50ae3b76-a775-435b-9932-fbf6218032bb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:02.640345 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-55fb2b8b-5aee-4c27-b937-7d9a1f117a45 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:02.640950 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-55fb2b8b-5aee-4c27-b937-7d9a1f117a45 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 362a9924-7119-4e2e-bd41-d68a5f545009] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:02.656946 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-55fb2b8b-5aee-4c27-b937-7d9a1f117a45 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:02.657693 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-55fb2b8b-5aee-4c27-b937-7d9a1f117a45 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:02.658917 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-55fb2b8b-5aee-4c27-b937-7d9a1f117a45 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:02.660503 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-55fb2b8b-5aee-4c27-b937-7d9a1f117a45 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:02.874849 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-55fb2b8b-5aee-4c27-b937-7d9a1f117a45 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:02.885009 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-55fb2b8b-5aee-4c27-b937-7d9a1f117a45 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009" status: 200 len: 1366 microversion: 2.1 time: 0.248461 May 10 21:23:02.885716 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 186/379] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:02 2022] GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:02.931045 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-50ae3b76-a775-435b-9932-fbf6218032bb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:02.945547 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-50ae3b76-a775-435b-9932-fbf6218032bb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:02.954205 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-50ae3b76-a775-435b-9932-fbf6218032bb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:02.956908 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-50ae3b76-a775-435b-9932-fbf6218032bb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1750 microversion: 2.20 time: 0.437114 May 10 21:23:02.957875 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 194/380] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:23:02 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1750 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:23:03.427973 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-47025640-68de-47e1-a716-7264f2ad7d23 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:03.429270 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-47025640-68de-47e1-a716-7264f2ad7d23 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:03.443892 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-47025640-68de-47e1-a716-7264f2ad7d23 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:03.445896 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-47025640-68de-47e1-a716-7264f2ad7d23 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:03.447646 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-47025640-68de-47e1-a716-7264f2ad7d23 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:03.452348 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-47025640-68de-47e1-a716-7264f2ad7d23 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:03.728899 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-47025640-68de-47e1-a716-7264f2ad7d23 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:03.741225 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-47025640-68de-47e1-a716-7264f2ad7d23 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1720 microversion: 2.1 time: 0.317311 May 10 21:23:03.741816 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 187/381] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:03 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1720 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:03.913230 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-be058992-dfd2-481c-9d68-21bd9323274a tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:03.914632 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-be058992-dfd2-481c-9d68-21bd9323274a tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 362a9924-7119-4e2e-bd41-d68a5f545009] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:03.925705 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-be058992-dfd2-481c-9d68-21bd9323274a tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:03.931776 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-be058992-dfd2-481c-9d68-21bd9323274a tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:03.931776 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-be058992-dfd2-481c-9d68-21bd9323274a tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:03.931776 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-be058992-dfd2-481c-9d68-21bd9323274a tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:03.978906 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-9a8d5a6d-1676-4498-9cba-2c7fe736404c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:03.979519 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-9a8d5a6d-1676-4498-9cba-2c7fe736404c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:03.996973 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9a8d5a6d-1676-4498-9cba-2c7fe736404c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:03.998461 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9a8d5a6d-1676-4498-9cba-2c7fe736404c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:04.003418 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9a8d5a6d-1676-4498-9cba-2c7fe736404c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:04.004447 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9a8d5a6d-1676-4498-9cba-2c7fe736404c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:04.152360 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-be058992-dfd2-481c-9d68-21bd9323274a tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:04.161839 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-be058992-dfd2-481c-9d68-21bd9323274a tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009" status: 200 len: 1366 microversion: 2.1 time: 0.257607 May 10 21:23:04.163412 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 195/382] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:03 2022] GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009 => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:04.635660 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-9a8d5a6d-1676-4498-9cba-2c7fe736404c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:04.655149 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-9a8d5a6d-1676-4498-9cba-2c7fe736404c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:04.659819 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-9a8d5a6d-1676-4498-9cba-2c7fe736404c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:04.665310 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-9a8d5a6d-1676-4498-9cba-2c7fe736404c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1752 microversion: 2.20 time: 0.691441 May 10 21:23:04.666655 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 188/383] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:23:03 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1752 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:23:04.762715 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-0dceb9bd-b31c-460c-86e9-1a75cc1581f2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:04.762715 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-0dceb9bd-b31c-460c-86e9-1a75cc1581f2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:04.771662 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0dceb9bd-b31c-460c-86e9-1a75cc1581f2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:04.775137 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0dceb9bd-b31c-460c-86e9-1a75cc1581f2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:04.776036 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0dceb9bd-b31c-460c-86e9-1a75cc1581f2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:04.776479 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0dceb9bd-b31c-460c-86e9-1a75cc1581f2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:05.045103 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-0dceb9bd-b31c-460c-86e9-1a75cc1581f2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:05.055578 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-0dceb9bd-b31c-460c-86e9-1a75cc1581f2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1720 microversion: 2.1 time: 0.300554 May 10 21:23:05.066386 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 196/384] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:04 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1720 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:05.182746 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-8db79487-e7bf-43be-b553-13fdd4c4a96d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:05.184845 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-8db79487-e7bf-43be-b553-13fdd4c4a96d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 362a9924-7119-4e2e-bd41-d68a5f545009] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:05.202638 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8db79487-e7bf-43be-b553-13fdd4c4a96d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:05.204310 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8db79487-e7bf-43be-b553-13fdd4c4a96d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:05.206022 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8db79487-e7bf-43be-b553-13fdd4c4a96d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:05.208853 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8db79487-e7bf-43be-b553-13fdd4c4a96d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:05.452730 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8db79487-e7bf-43be-b553-13fdd4c4a96d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:05.467277 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-8db79487-e7bf-43be-b553-13fdd4c4a96d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009" status: 200 len: 1366 microversion: 2.1 time: 0.293097 May 10 21:23:05.468537 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 189/385] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:05 2022] GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009 => generated 1366 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:05.693721 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-dc960d0e-a72c-4dfb-bcd5-09e4b8ecd7cb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:05.695338 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-dc960d0e-a72c-4dfb-bcd5-09e4b8ecd7cb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:05.705038 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-dc960d0e-a72c-4dfb-bcd5-09e4b8ecd7cb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:05.705745 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-dc960d0e-a72c-4dfb-bcd5-09e4b8ecd7cb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:05.707084 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-dc960d0e-a72c-4dfb-bcd5-09e4b8ecd7cb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:05.707687 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-dc960d0e-a72c-4dfb-bcd5-09e4b8ecd7cb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:06.074484 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-b11a784d-4e40-4529-8872-08aafefb51d8 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:06.075095 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-b11a784d-4e40-4529-8872-08aafefb51d8 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:06.086220 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b11a784d-4e40-4529-8872-08aafefb51d8 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:06.086693 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b11a784d-4e40-4529-8872-08aafefb51d8 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:06.091579 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b11a784d-4e40-4529-8872-08aafefb51d8 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:06.091579 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b11a784d-4e40-4529-8872-08aafefb51d8 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:06.233505 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-dc960d0e-a72c-4dfb-bcd5-09e4b8ecd7cb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:06.243841 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-dc960d0e-a72c-4dfb-bcd5-09e4b8ecd7cb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:06.245539 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-dc960d0e-a72c-4dfb-bcd5-09e4b8ecd7cb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:06.247241 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-dc960d0e-a72c-4dfb-bcd5-09e4b8ecd7cb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1808 microversion: 2.20 time: 0.557857 May 10 21:23:06.258039 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 197/386] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:23:05 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1808 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:23:06.399743 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b11a784d-4e40-4529-8872-08aafefb51d8 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:06.410408 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-b11a784d-4e40-4529-8872-08aafefb51d8 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1720 microversion: 2.1 time: 0.339639 May 10 21:23:06.423202 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 190/387] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:06 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1720 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:06.488589 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-4c735d34-1ff7-4d42-8898-9208ef9963da tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:06.489920 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-4c735d34-1ff7-4d42-8898-9208ef9963da tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 362a9924-7119-4e2e-bd41-d68a5f545009] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:06.496984 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4c735d34-1ff7-4d42-8898-9208ef9963da tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:06.498105 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4c735d34-1ff7-4d42-8898-9208ef9963da tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:06.508567 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4c735d34-1ff7-4d42-8898-9208ef9963da tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:06.508567 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4c735d34-1ff7-4d42-8898-9208ef9963da tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:06.758722 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-4c735d34-1ff7-4d42-8898-9208ef9963da tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:06.773266 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-4c735d34-1ff7-4d42-8898-9208ef9963da tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009" status: 200 len: 1366 microversion: 2.1 time: 0.292833 May 10 21:23:06.773867 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 198/388] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:06 2022] GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009 => generated 1366 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:06.886997 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-a9e44b14-1021-4eb5-a44e-ece1eaa43dc4 req-f9008823-a683-4477-8d37-c011f119afeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "362a9924-7119-4e2e-bd41-d68a5f545009", "name": "network-vif-plugged", "status": "completed", "tag": "d51acf48-316f-4040-b5d3-2beac72dba60"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:23:06.902561 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-a9e44b14-1021-4eb5-a44e-ece1eaa43dc4 req-f9008823-a683-4477-8d37-c011f119afeb service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:06.906129 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-a9e44b14-1021-4eb5-a44e-ece1eaa43dc4 req-f9008823-a683-4477-8d37-c011f119afeb service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:06.929577 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-a9e44b14-1021-4eb5-a44e-ece1eaa43dc4 req-f9008823-a683-4477-8d37-c011f119afeb service nova] Creating event network-vif-plugged:d51acf48-316f-4040-b5d3-2beac72dba60 for instance 362a9924-7119-4e2e-bd41-d68a5f545009 on hv-cinder-83608 May 10 21:23:06.938714 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-a9e44b14-1021-4eb5-a44e-ece1eaa43dc4 req-f9008823-a683-4477-8d37-c011f119afeb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058711 May 10 21:23:06.939709 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 191/389] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:23:07.273947 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-f0d6eeb4-0e04-439e-856b-78c4b839fd8d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:07.274796 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-f0d6eeb4-0e04-439e-856b-78c4b839fd8d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:07.292723 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f0d6eeb4-0e04-439e-856b-78c4b839fd8d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:07.295437 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f0d6eeb4-0e04-439e-856b-78c4b839fd8d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:07.299944 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f0d6eeb4-0e04-439e-856b-78c4b839fd8d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:07.300401 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f0d6eeb4-0e04-439e-856b-78c4b839fd8d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:07.441737 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6d27664e-3331-41a4-abd0-ab8c190e54cc tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:07.443720 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-6d27664e-3331-41a4-abd0-ab8c190e54cc tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:07.469745 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6d27664e-3331-41a4-abd0-ab8c190e54cc tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:07.471663 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6d27664e-3331-41a4-abd0-ab8c190e54cc tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:07.473028 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6d27664e-3331-41a4-abd0-ab8c190e54cc tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:07.474152 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6d27664e-3331-41a4-abd0-ab8c190e54cc tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:07.593451 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-f0d6eeb4-0e04-439e-856b-78c4b839fd8d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:07.607401 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-f0d6eeb4-0e04-439e-856b-78c4b839fd8d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:07.610410 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-f0d6eeb4-0e04-439e-856b-78c4b839fd8d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:07.612183 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-f0d6eeb4-0e04-439e-856b-78c4b839fd8d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1808 microversion: 2.20 time: 0.347043 May 10 21:23:07.624983 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 199/390] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:23:07 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1808 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:23:07.793699 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-88c74376-e32f-4244-a5ac-302517876de3 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:07.798326 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-6d27664e-3331-41a4-abd0-ab8c190e54cc tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:07.800556 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-88c74376-e32f-4244-a5ac-302517876de3 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 362a9924-7119-4e2e-bd41-d68a5f545009] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:07.813616 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-88c74376-e32f-4244-a5ac-302517876de3 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:07.816031 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-88c74376-e32f-4244-a5ac-302517876de3 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:07.816031 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-88c74376-e32f-4244-a5ac-302517876de3 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:07.816031 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-88c74376-e32f-4244-a5ac-302517876de3 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:07.819134 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-6d27664e-3331-41a4-abd0-ab8c190e54cc tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1697 microversion: 2.1 time: 0.383144 May 10 21:23:07.827596 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 192/391] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:07 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1697 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:07.837129 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-33a98c3a-8651-44b4-a23b-78ec79b47019 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:23:07.856666 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-33a98c3a-8651-44b4-a23b-78ec79b47019 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:07.857111 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-33a98c3a-8651-44b4-a23b-78ec79b47019 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:07.988070 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-33a98c3a-8651-44b4-a23b-78ec79b47019 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Going to try to start instance {{(pid=117679) start /opt/stack/nova/nova/compute/api.py:2730}} May 10 21:23:08.071094 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-88c74376-e32f-4244-a5ac-302517876de3 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:08.078492 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-88c74376-e32f-4244-a5ac-302517876de3 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009" status: 200 len: 1366 microversion: 2.1 time: 0.291809 May 10 21:23:08.087535 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 200/392] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:07 2022] GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009 => generated 1366 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:08.229916 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-33a98c3a-8651-44b4-a23b-78ec79b47019 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "POST /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70/action" status: 202 len: 0 microversion: 2.1 time: 0.397467 May 10 21:23:08.231079 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 193/393] 10.222.0.25 () {60 vars in 1277 bytes} [Tue May 10 21:23:07 2022] POST /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 21:23:08.239936 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-3daf246e-0d62-4ace-b48d-287b0c024764 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:08.240620 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-3daf246e-0d62-4ace-b48d-287b0c024764 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:08.248085 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3daf246e-0d62-4ace-b48d-287b0c024764 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:08.249781 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3daf246e-0d62-4ace-b48d-287b0c024764 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:08.251272 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3daf246e-0d62-4ace-b48d-287b0c024764 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:08.251779 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3daf246e-0d62-4ace-b48d-287b0c024764 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:08.450182 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-3daf246e-0d62-4ace-b48d-287b0c024764 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:08.459416 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-3daf246e-0d62-4ace-b48d-287b0c024764 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1706 microversion: 2.1 time: 0.223398 May 10 21:23:08.460000 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 201/394] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:08 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1706 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:08.631911 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-acd1ccfd-340d-47bf-b8bf-88009531c8b9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:08.635217 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-acd1ccfd-340d-47bf-b8bf-88009531c8b9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:08.642551 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-acd1ccfd-340d-47bf-b8bf-88009531c8b9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:08.645939 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-acd1ccfd-340d-47bf-b8bf-88009531c8b9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:08.649112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-acd1ccfd-340d-47bf-b8bf-88009531c8b9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:08.649788 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-acd1ccfd-340d-47bf-b8bf-88009531c8b9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:09.096692 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-f714b83d-f77e-4c4c-b73c-546244e53218 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:09.097591 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-f714b83d-f77e-4c4c-b73c-546244e53218 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 362a9924-7119-4e2e-bd41-d68a5f545009] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:09.108568 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f714b83d-f77e-4c4c-b73c-546244e53218 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:09.110143 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f714b83d-f77e-4c4c-b73c-546244e53218 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:09.112397 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f714b83d-f77e-4c4c-b73c-546244e53218 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:09.113037 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f714b83d-f77e-4c4c-b73c-546244e53218 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:09.386142 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-f714b83d-f77e-4c4c-b73c-546244e53218 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:09.396285 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-f714b83d-f77e-4c4c-b73c-546244e53218 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009" status: 200 len: 1366 microversion: 2.1 time: 0.304451 May 10 21:23:09.400212 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 202/395] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:09 2022] GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009 => generated 1366 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:09.477463 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-acd1ccfd-340d-47bf-b8bf-88009531c8b9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:09.481807 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-8757b67c-5080-422a-a335-f711fa00b25a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:09.483607 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-8757b67c-5080-422a-a335-f711fa00b25a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:09.488219 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-acd1ccfd-340d-47bf-b8bf-88009531c8b9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:09.495936 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8757b67c-5080-422a-a335-f711fa00b25a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:09.501475 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-acd1ccfd-340d-47bf-b8bf-88009531c8b9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:09.504336 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8757b67c-5080-422a-a335-f711fa00b25a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:09.505680 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-acd1ccfd-340d-47bf-b8bf-88009531c8b9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1808 microversion: 2.20 time: 0.875351 May 10 21:23:09.517809 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 194/396] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:23:08 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1808 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:23:09.532587 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8757b67c-5080-422a-a335-f711fa00b25a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:09.537645 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8757b67c-5080-422a-a335-f711fa00b25a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:09.843184 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-8757b67c-5080-422a-a335-f711fa00b25a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:09.856201 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-8757b67c-5080-422a-a335-f711fa00b25a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1706 microversion: 2.1 time: 0.379572 May 10 21:23:09.871862 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 203/397] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:09 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1706 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:10.417638 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-764d5c19-31de-42e1-ae21-fbe345f4d75c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:10.418255 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-764d5c19-31de-42e1-ae21-fbe345f4d75c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 362a9924-7119-4e2e-bd41-d68a5f545009] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:10.434722 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-764d5c19-31de-42e1-ae21-fbe345f4d75c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:10.436322 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-764d5c19-31de-42e1-ae21-fbe345f4d75c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:10.437437 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-764d5c19-31de-42e1-ae21-fbe345f4d75c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:10.440174 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-764d5c19-31de-42e1-ae21-fbe345f4d75c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:10.533943 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-55b6d9e1-7565-4096-a9b0-54885dae1359 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:10.535364 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-55b6d9e1-7565-4096-a9b0-54885dae1359 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:10.689603 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-55b6d9e1-7565-4096-a9b0-54885dae1359 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:10.689603 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-55b6d9e1-7565-4096-a9b0-54885dae1359 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:10.689603 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-55b6d9e1-7565-4096-a9b0-54885dae1359 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:10.689603 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-55b6d9e1-7565-4096-a9b0-54885dae1359 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:10.932959 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-764d5c19-31de-42e1-ae21-fbe345f4d75c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:10.932959 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-764d5c19-31de-42e1-ae21-fbe345f4d75c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009" status: 200 len: 1557 microversion: 2.1 time: 0.507738 May 10 21:23:10.932959 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 195/398] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:10 2022] GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009 => generated 1557 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:10.951531 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-dc797af7-ea09-4e16-974e-916fd9a5c21b tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:10.953126 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-dc797af7-ea09-4e16-974e-916fd9a5c21b tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:10.961398 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dc797af7-ea09-4e16-974e-916fd9a5c21b tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:10.963186 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dc797af7-ea09-4e16-974e-916fd9a5c21b tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:10.964395 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dc797af7-ea09-4e16-974e-916fd9a5c21b tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:10.965095 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dc797af7-ea09-4e16-974e-916fd9a5c21b tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:11.006685 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-55b6d9e1-7565-4096-a9b0-54885dae1359 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:11.025682 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-55b6d9e1-7565-4096-a9b0-54885dae1359 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:11.027673 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-55b6d9e1-7565-4096-a9b0-54885dae1359 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:11.031249 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-55b6d9e1-7565-4096-a9b0-54885dae1359 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1808 microversion: 2.20 time: 0.502288 May 10 21:23:11.043925 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 204/399] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:23:10 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1808 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:23:11.056058 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-95ce57aa-671f-4faf-b4d0-56b918fc93d5 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:11.063231 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-95ce57aa-671f-4faf-b4d0-56b918fc93d5 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 362a9924-7119-4e2e-bd41-d68a5f545009] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:11.070225 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-95ce57aa-671f-4faf-b4d0-56b918fc93d5 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:11.075545 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-95ce57aa-671f-4faf-b4d0-56b918fc93d5 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:11.078509 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-95ce57aa-671f-4faf-b4d0-56b918fc93d5 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:11.078509 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-95ce57aa-671f-4faf-b4d0-56b918fc93d5 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:11.368474 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-95ce57aa-671f-4faf-b4d0-56b918fc93d5 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.320612 May 10 21:23:11.376979 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 205/400] 10.222.0.25 () {58 vars in 1274 bytes} [Tue May 10 21:23:11 2022] GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009/os-interface => generated 285 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:23:11.486086 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-dc797af7-ea09-4e16-974e-916fd9a5c21b tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:11.500661 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-dc797af7-ea09-4e16-974e-916fd9a5c21b tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1706 microversion: 2.1 time: 0.570473 May 10 21:23:11.502810 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 196/401] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:10 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1706 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:12.060246 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-62fc81c1-e74e-4a24-aa8d-1f2898b6ae91 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:12.060951 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-62fc81c1-e74e-4a24-aa8d-1f2898b6ae91 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:12.075792 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-62fc81c1-e74e-4a24-aa8d-1f2898b6ae91 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:12.076244 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-62fc81c1-e74e-4a24-aa8d-1f2898b6ae91 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:12.078559 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-62fc81c1-e74e-4a24-aa8d-1f2898b6ae91 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:12.084937 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-62fc81c1-e74e-4a24-aa8d-1f2898b6ae91 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:12.522018 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e3ec392b-d672-4e81-9012-b204a380901f tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:12.522752 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-e3ec392b-d672-4e81-9012-b204a380901f tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:12.547605 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e3ec392b-d672-4e81-9012-b204a380901f tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:12.548468 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e3ec392b-d672-4e81-9012-b204a380901f tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:12.551791 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e3ec392b-d672-4e81-9012-b204a380901f tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:12.552498 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e3ec392b-d672-4e81-9012-b204a380901f tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:12.908827 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-e3ec392b-d672-4e81-9012-b204a380901f tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:12.921923 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-e3ec392b-d672-4e81-9012-b204a380901f tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1706 microversion: 2.1 time: 0.405130 May 10 21:23:12.924716 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 197/402] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:12 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1706 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:12.968147 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-62fc81c1-e74e-4a24-aa8d-1f2898b6ae91 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:12.979742 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-62fc81c1-e74e-4a24-aa8d-1f2898b6ae91 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:12.981625 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-62fc81c1-e74e-4a24-aa8d-1f2898b6ae91 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:12.984082 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-62fc81c1-e74e-4a24-aa8d-1f2898b6ae91 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1808 microversion: 2.20 time: 0.932276 May 10 21:23:12.985972 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 206/403] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:23:12 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1808 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:23:13.778169 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-46961921-5a14-4772-957f-01c72b8f674e req-7f950272-ac89-44e9-bca0-612d4b7a3e16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "362a9924-7119-4e2e-bd41-d68a5f545009", "tag": "d51acf48-316f-4040-b5d3-2beac72dba60"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:23:13.790999 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-46961921-5a14-4772-957f-01c72b8f674e req-7f950272-ac89-44e9-bca0-612d4b7a3e16 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:13.791819 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-46961921-5a14-4772-957f-01c72b8f674e req-7f950272-ac89-44e9-bca0-612d4b7a3e16 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:13.849046 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-46961921-5a14-4772-957f-01c72b8f674e req-7f950272-ac89-44e9-bca0-612d4b7a3e16 service nova] Creating event network-changed:d51acf48-316f-4040-b5d3-2beac72dba60 for instance 362a9924-7119-4e2e-bd41-d68a5f545009 on hv-cinder-83608 May 10 21:23:13.849046 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-46961921-5a14-4772-957f-01c72b8f674e req-7f950272-ac89-44e9-bca0-612d4b7a3e16 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035106 May 10 21:23:13.849046 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 198/404] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:23:13.940624 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-930636b7-9755-49c8-b77b-4553c8245004 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:13.941246 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-930636b7-9755-49c8-b77b-4553c8245004 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:13.947960 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-930636b7-9755-49c8-b77b-4553c8245004 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:13.948606 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-930636b7-9755-49c8-b77b-4553c8245004 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:13.949415 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-930636b7-9755-49c8-b77b-4553c8245004 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:13.949882 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-930636b7-9755-49c8-b77b-4553c8245004 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:14.004725 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-870e480e-0d8e-4779-a686-88c41cd2e0d5 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:14.005941 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-870e480e-0d8e-4779-a686-88c41cd2e0d5 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:14.013499 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-870e480e-0d8e-4779-a686-88c41cd2e0d5 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:14.015062 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-870e480e-0d8e-4779-a686-88c41cd2e0d5 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:14.016264 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-870e480e-0d8e-4779-a686-88c41cd2e0d5 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:14.016923 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-870e480e-0d8e-4779-a686-88c41cd2e0d5 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:14.283429 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-930636b7-9755-49c8-b77b-4553c8245004 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:14.305020 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-930636b7-9755-49c8-b77b-4553c8245004 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1706 microversion: 2.1 time: 0.368468 May 10 21:23:14.309533 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 207/405] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:13 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1706 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:14.488390 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-870e480e-0d8e-4779-a686-88c41cd2e0d5 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:14.497920 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-870e480e-0d8e-4779-a686-88c41cd2e0d5 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:14.503957 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-870e480e-0d8e-4779-a686-88c41cd2e0d5 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:14.507153 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-870e480e-0d8e-4779-a686-88c41cd2e0d5 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1808 microversion: 2.20 time: 0.506866 May 10 21:23:14.545820 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 199/406] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:23:13 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1808 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:23:15.325141 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-af673052-2ee2-448b-af36-9770e02f7666 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:15.325843 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-af673052-2ee2-448b-af36-9770e02f7666 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:15.336527 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-af673052-2ee2-448b-af36-9770e02f7666 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:15.337368 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-af673052-2ee2-448b-af36-9770e02f7666 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:15.338385 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-af673052-2ee2-448b-af36-9770e02f7666 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:15.339060 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-af673052-2ee2-448b-af36-9770e02f7666 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:15.543582 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-b4d6cbb6-9d7e-4d4b-b445-71aa6d737b84 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:15.545023 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-b4d6cbb6-9d7e-4d4b-b445-71aa6d737b84 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:15.560788 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b4d6cbb6-9d7e-4d4b-b445-71aa6d737b84 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:15.564974 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b4d6cbb6-9d7e-4d4b-b445-71aa6d737b84 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:15.566214 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b4d6cbb6-9d7e-4d4b-b445-71aa6d737b84 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:15.574513 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b4d6cbb6-9d7e-4d4b-b445-71aa6d737b84 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:15.582908 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-af673052-2ee2-448b-af36-9770e02f7666 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:15.591673 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-af673052-2ee2-448b-af36-9770e02f7666 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1710 microversion: 2.1 time: 0.270854 May 10 21:23:15.601997 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 208/407] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:15 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1710 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:15.903928 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b4d6cbb6-9d7e-4d4b-b445-71aa6d737b84 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:15.916082 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b4d6cbb6-9d7e-4d4b-b445-71aa6d737b84 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:15.918357 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b4d6cbb6-9d7e-4d4b-b445-71aa6d737b84 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:15.923033 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-b4d6cbb6-9d7e-4d4b-b445-71aa6d737b84 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1808 microversion: 2.20 time: 0.383208 May 10 21:23:15.934772 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 200/408] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:23:15 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1808 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:23:16.942121 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-f26701f0-29b1-49b6-994d-5e5e07b23954 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:16.942863 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-f26701f0-29b1-49b6-994d-5e5e07b23954 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:16.966732 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f26701f0-29b1-49b6-994d-5e5e07b23954 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:16.974499 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f26701f0-29b1-49b6-994d-5e5e07b23954 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:16.975707 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f26701f0-29b1-49b6-994d-5e5e07b23954 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:16.976357 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f26701f0-29b1-49b6-994d-5e5e07b23954 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:17.232278 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-f26701f0-29b1-49b6-994d-5e5e07b23954 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:17.255873 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-f26701f0-29b1-49b6-994d-5e5e07b23954 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:17.257678 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-f26701f0-29b1-49b6-994d-5e5e07b23954 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:17.282711 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-f26701f0-29b1-49b6-994d-5e5e07b23954 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1808 microversion: 2.20 time: 0.329225 May 10 21:23:17.282711 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 209/409] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:23:16 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1808 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:23:18.299447 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-0fd22591-a51e-4c04-ba97-62b2120ceee7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:18.300717 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-0fd22591-a51e-4c04-ba97-62b2120ceee7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:18.308082 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0fd22591-a51e-4c04-ba97-62b2120ceee7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:18.309277 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0fd22591-a51e-4c04-ba97-62b2120ceee7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:18.313637 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0fd22591-a51e-4c04-ba97-62b2120ceee7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:18.314350 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0fd22591-a51e-4c04-ba97-62b2120ceee7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:18.511940 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-0fd22591-a51e-4c04-ba97-62b2120ceee7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:18.526756 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-0fd22591-a51e-4c04-ba97-62b2120ceee7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:18.528456 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-0fd22591-a51e-4c04-ba97-62b2120ceee7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:18.529628 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-0fd22591-a51e-4c04-ba97-62b2120ceee7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1808 microversion: 2.20 time: 0.237015 May 10 21:23:18.548713 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 201/410] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:23:18 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1808 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:23:19.555371 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-c3ec199c-5b52-4f01-9a20-296ec90bc943 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:19.556610 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-c3ec199c-5b52-4f01-9a20-296ec90bc943 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:19.566702 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c3ec199c-5b52-4f01-9a20-296ec90bc943 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:19.567458 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c3ec199c-5b52-4f01-9a20-296ec90bc943 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:19.568523 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c3ec199c-5b52-4f01-9a20-296ec90bc943 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:19.568951 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c3ec199c-5b52-4f01-9a20-296ec90bc943 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:19.785158 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-c3ec199c-5b52-4f01-9a20-296ec90bc943 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:19.799727 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-c3ec199c-5b52-4f01-9a20-296ec90bc943 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:19.801748 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-c3ec199c-5b52-4f01-9a20-296ec90bc943 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:19.805480 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-c3ec199c-5b52-4f01-9a20-296ec90bc943 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1808 microversion: 2.20 time: 0.253925 May 10 21:23:19.810022 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 210/411] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:23:19 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1808 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:23:20.830882 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-12bd25a4-0b58-4cc5-be08-cc667e4db7ba tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:20.831564 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-12bd25a4-0b58-4cc5-be08-cc667e4db7ba tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:20.851359 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-12bd25a4-0b58-4cc5-be08-cc667e4db7ba tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:20.851888 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-12bd25a4-0b58-4cc5-be08-cc667e4db7ba tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:20.852685 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-12bd25a4-0b58-4cc5-be08-cc667e4db7ba tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:20.853119 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-12bd25a4-0b58-4cc5-be08-cc667e4db7ba tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:21.077806 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-12bd25a4-0b58-4cc5-be08-cc667e4db7ba tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:21.089617 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-12bd25a4-0b58-4cc5-be08-cc667e4db7ba tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:21.091351 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-12bd25a4-0b58-4cc5-be08-cc667e4db7ba tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:21.093486 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-12bd25a4-0b58-4cc5-be08-cc667e4db7ba tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1808 microversion: 2.20 time: 0.266809 May 10 21:23:21.102301 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 202/412] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:23:20 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1808 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:23:21.918866 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-973ab842-0973-4edc-bb46-fbc2f761f312 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Action: 'create', calling method: .version_select at 0x7f7aea53b160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1471037199", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOhqWN8sMvh2f5SXqp/i37knMjZ4xk+jzy3MTXaM5iWoZc6uGBMbiqG96JyM47BsXNeQgh5KiVP5ftstjSRYcKhiLwHMWglC1KBS0JnW4ie26wEDC3ush5I0W8k5VfuzA=="}} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:23:21.934989 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.quota [None req-973ab842-0973-4edc-bb46-fbc2f761f312 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Getting quotas for project 7858ff72ee9843a493c27f9592a540b0. Resources: {'key_pairs'} {{(pid=117678) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:23:21.940238 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.quota [None req-973ab842-0973-4edc-bb46-fbc2f761f312 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Getting quotas for user cee2a53cb70b4281bb49e39d70abfaa6 and project 7858ff72ee9843a493c27f9592a540b0. Resources: {'key_pairs'} {{(pid=117678) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:23:21.994034 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-973ab842-0973-4edc-bb46-fbc2f761f312 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.079010 May 10 21:23:21.994667 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 211/413] 10.222.0.25 () {60 vars in 1158 bytes} [Tue May 10 21:23:21 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:23:22.092751 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-385fb015-119b-42c2-be6f-29dcf073d8b8 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-966568433", "imageRef": "ea18945e-24ad-4213-a67c-148ad1377511", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1471037199", "networks": [{"uuid": "542a7900-ef11-4cb8-92b8-4e9f6e52a9ae"}]}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:23:22.113228 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-1f9e4ae4-69e7-4e58-87d8-72d2d7840e49 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:22.113906 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-1f9e4ae4-69e7-4e58-87d8-72d2d7840e49 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:22.119986 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1f9e4ae4-69e7-4e58-87d8-72d2d7840e49 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:22.121883 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1f9e4ae4-69e7-4e58-87d8-72d2d7840e49 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:22.121883 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1f9e4ae4-69e7-4e58-87d8-72d2d7840e49 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:22.121883 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1f9e4ae4-69e7-4e58-87d8-72d2d7840e49 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:22.147434 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.network.neutron [None req-385fb015-119b-42c2-be6f-29dcf073d8b8 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] validate_networks() for [('542a7900-ef11-4cb8-92b8-4e9f6e52a9ae', None, None, None, None, None)] {{(pid=117679) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 21:23:22.257298 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-1f9e4ae4-69e7-4e58-87d8-72d2d7840e49 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:22.266320 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-1f9e4ae4-69e7-4e58-87d8-72d2d7840e49 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:22.267875 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-1f9e4ae4-69e7-4e58-87d8-72d2d7840e49 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:22.269026 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-1f9e4ae4-69e7-4e58-87d8-72d2d7840e49 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1808 microversion: 2.20 time: 0.160007 May 10 21:23:22.269725 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 212/414] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:23:22 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:23:22.515928 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-385fb015-119b-42c2-be6f-29dcf073d8b8 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Flavor limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 21:23:22.516356 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-385fb015-119b-42c2-be6f-29dcf073d8b8 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Image limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 21:23:22.516861 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-385fb015-119b-42c2-be6f-29dcf073d8b8 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Flavor pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 21:23:22.517275 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-385fb015-119b-42c2-be6f-29dcf073d8b8 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Image pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 21:23:22.517725 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-385fb015-119b-42c2-be6f-29dcf073d8b8 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 21:23:22.526294 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-385fb015-119b-42c2-be6f-29dcf073d8b8 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:22.526775 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-385fb015-119b-42c2-be6f-29dcf073d8b8 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:22.527576 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-385fb015-119b-42c2-be6f-29dcf073d8b8 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:22.528009 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-385fb015-119b-42c2-be6f-29dcf073d8b8 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:22.544647 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-385fb015-119b-42c2-be6f-29dcf073d8b8 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Getting quotas for project 7858ff72ee9843a493c27f9592a540b0. Resources: {'cores', 'instances', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:23:22.548583 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-385fb015-119b-42c2-be6f-29dcf073d8b8 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Getting quotas for user cee2a53cb70b4281bb49e39d70abfaa6 and project 7858ff72ee9843a493c27f9592a540b0. Resources: {'cores', 'instances', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:23:22.559289 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-385fb015-119b-42c2-be6f-29dcf073d8b8 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Going to run 1 instances... {{(pid=117679) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 21:23:22.561518 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-385fb015-119b-42c2-be6f-29dcf073d8b8 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ea18945e-24ad-4213-a67c-148ad1377511',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 21:23:22.708274 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-385fb015-119b-42c2-be6f-29dcf073d8b8 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.619299 May 10 21:23:22.708909 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 203/415] 10.222.0.25 () {60 vars in 1146 bytes} [Tue May 10 21:23:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 21:23:22.719716 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-b6345171-4f49-4773-829b-4cabf6410429 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:22.721882 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-b6345171-4f49-4773-829b-4cabf6410429 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:22.774092 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-b6345171-4f49-4773-829b-4cabf6410429 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:22.781436 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-b6345171-4f49-4773-829b-4cabf6410429 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1258 microversion: 2.1 time: 0.066293 May 10 21:23:22.782014 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 213/416] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:22 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1258 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:23.288736 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-3ecf873c-f46c-47c9-a954-e6fa1376708a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:23.289961 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-3ecf873c-f46c-47c9-a954-e6fa1376708a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:23.296697 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3ecf873c-f46c-47c9-a954-e6fa1376708a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:23.297149 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3ecf873c-f46c-47c9-a954-e6fa1376708a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:23.297948 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3ecf873c-f46c-47c9-a954-e6fa1376708a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:23.298408 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3ecf873c-f46c-47c9-a954-e6fa1376708a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:23.427556 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-3ecf873c-f46c-47c9-a954-e6fa1376708a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:23.435809 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-3ecf873c-f46c-47c9-a954-e6fa1376708a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:23.437312 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-3ecf873c-f46c-47c9-a954-e6fa1376708a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:23.438477 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-3ecf873c-f46c-47c9-a954-e6fa1376708a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1808 microversion: 2.20 time: 0.154915 May 10 21:23:23.439038 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 204/417] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:23:23 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:23:23.798260 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-83debfde-baa8-49b1-b12f-c77a3df62a42 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:23.798844 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-83debfde-baa8-49b1-b12f-c77a3df62a42 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:23.805760 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-83debfde-baa8-49b1-b12f-c77a3df62a42 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:23.806207 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-83debfde-baa8-49b1-b12f-c77a3df62a42 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:23.807004 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-83debfde-baa8-49b1-b12f-c77a3df62a42 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:23.807433 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-83debfde-baa8-49b1-b12f-c77a3df62a42 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:23.871684 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-83debfde-baa8-49b1-b12f-c77a3df62a42 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:23.879344 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-83debfde-baa8-49b1-b12f-c77a3df62a42 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1262 microversion: 2.1 time: 0.085019 May 10 21:23:23.879924 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 214/418] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:23 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:24.457183 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-b727e4ff-3d91-420b-8cde-dd9069a048ee tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:24.457780 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-b727e4ff-3d91-420b-8cde-dd9069a048ee tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:24.464234 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b727e4ff-3d91-420b-8cde-dd9069a048ee tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:24.464682 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b727e4ff-3d91-420b-8cde-dd9069a048ee tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:24.465476 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b727e4ff-3d91-420b-8cde-dd9069a048ee tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:24.465909 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b727e4ff-3d91-420b-8cde-dd9069a048ee tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:24.600583 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b727e4ff-3d91-420b-8cde-dd9069a048ee tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:24.608834 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b727e4ff-3d91-420b-8cde-dd9069a048ee tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:24.610330 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b727e4ff-3d91-420b-8cde-dd9069a048ee tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:24.611535 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-b727e4ff-3d91-420b-8cde-dd9069a048ee tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1808 microversion: 2.20 time: 0.158412 May 10 21:23:24.612095 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 205/419] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:23:24 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:23:24.896585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-cc785c15-2796-45fa-900c-b7a54b2c3a02 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:24.897247 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-cc785c15-2796-45fa-900c-b7a54b2c3a02 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:24.903562 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-cc785c15-2796-45fa-900c-b7a54b2c3a02 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:24.904003 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-cc785c15-2796-45fa-900c-b7a54b2c3a02 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:24.904761 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-cc785c15-2796-45fa-900c-b7a54b2c3a02 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:24.905347 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-cc785c15-2796-45fa-900c-b7a54b2c3a02 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:24.968030 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-cc785c15-2796-45fa-900c-b7a54b2c3a02 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:24.975260 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-cc785c15-2796-45fa-900c-b7a54b2c3a02 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1310 microversion: 2.1 time: 0.082520 May 10 21:23:24.975827 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 215/420] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:24 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1310 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:25.629420 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-2e308cc3-0cf7-4825-a412-fd07613d4e74 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:25.630221 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-2e308cc3-0cf7-4825-a412-fd07613d4e74 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:25.637519 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2e308cc3-0cf7-4825-a412-fd07613d4e74 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:25.638159 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2e308cc3-0cf7-4825-a412-fd07613d4e74 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:25.639126 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2e308cc3-0cf7-4825-a412-fd07613d4e74 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:25.640386 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2e308cc3-0cf7-4825-a412-fd07613d4e74 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:25.790205 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2e308cc3-0cf7-4825-a412-fd07613d4e74 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:25.798972 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2e308cc3-0cf7-4825-a412-fd07613d4e74 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:25.800471 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2e308cc3-0cf7-4825-a412-fd07613d4e74 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:25.801625 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-2e308cc3-0cf7-4825-a412-fd07613d4e74 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1808 microversion: 2.20 time: 0.176180 May 10 21:23:25.802188 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 206/421] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:23:25 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:23:25.997707 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-1d64e322-f338-4b60-a920-22785257fe24 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:25.999628 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-1d64e322-f338-4b60-a920-22785257fe24 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:26.009117 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1d64e322-f338-4b60-a920-22785257fe24 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:26.009970 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1d64e322-f338-4b60-a920-22785257fe24 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:26.011129 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1d64e322-f338-4b60-a920-22785257fe24 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:26.011796 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1d64e322-f338-4b60-a920-22785257fe24 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:26.206999 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-1d64e322-f338-4b60-a920-22785257fe24 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:26.216683 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-1d64e322-f338-4b60-a920-22785257fe24 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1358 microversion: 2.1 time: 0.222978 May 10 21:23:26.217614 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 216/422] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:25 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:26.819984 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-1599cc8a-0118-4029-90e9-bf95518528d4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:26.820588 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-1599cc8a-0118-4029-90e9-bf95518528d4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:26.827200 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1599cc8a-0118-4029-90e9-bf95518528d4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:26.827663 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1599cc8a-0118-4029-90e9-bf95518528d4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:26.828427 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1599cc8a-0118-4029-90e9-bf95518528d4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:26.829030 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1599cc8a-0118-4029-90e9-bf95518528d4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:26.964354 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1599cc8a-0118-4029-90e9-bf95518528d4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:26.973455 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1599cc8a-0118-4029-90e9-bf95518528d4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:26.974966 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1599cc8a-0118-4029-90e9-bf95518528d4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:26.976114 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-1599cc8a-0118-4029-90e9-bf95518528d4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1808 microversion: 2.20 time: 0.160269 May 10 21:23:26.976673 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 207/423] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:23:26 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:23:27.233077 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-1adaa055-3ca0-485b-bde2-2517a5fddcb2 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:27.233861 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-1adaa055-3ca0-485b-bde2-2517a5fddcb2 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:27.240256 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1adaa055-3ca0-485b-bde2-2517a5fddcb2 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:27.240772 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1adaa055-3ca0-485b-bde2-2517a5fddcb2 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:27.242496 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1adaa055-3ca0-485b-bde2-2517a5fddcb2 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:27.242959 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1adaa055-3ca0-485b-bde2-2517a5fddcb2 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:27.380950 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-1adaa055-3ca0-485b-bde2-2517a5fddcb2 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:27.390503 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-1adaa055-3ca0-485b-bde2-2517a5fddcb2 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1358 microversion: 2.1 time: 0.160577 May 10 21:23:27.391101 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 217/424] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:27 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:27.994493 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-80febcd8-fa5d-4105-9ab7-a3b3e4bb2362 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:27.995747 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-80febcd8-fa5d-4105-9ab7-a3b3e4bb2362 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:28.003668 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-80febcd8-fa5d-4105-9ab7-a3b3e4bb2362 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:28.004165 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-80febcd8-fa5d-4105-9ab7-a3b3e4bb2362 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:28.004955 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-80febcd8-fa5d-4105-9ab7-a3b3e4bb2362 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:28.005401 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-80febcd8-fa5d-4105-9ab7-a3b3e4bb2362 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:28.139681 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-80febcd8-fa5d-4105-9ab7-a3b3e4bb2362 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:28.148387 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-80febcd8-fa5d-4105-9ab7-a3b3e4bb2362 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:28.150078 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-80febcd8-fa5d-4105-9ab7-a3b3e4bb2362 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:28.152967 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-80febcd8-fa5d-4105-9ab7-a3b3e4bb2362 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1808 microversion: 2.20 time: 0.162409 May 10 21:23:28.153708 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 208/425] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:23:27 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:23:28.411870 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-96ecc252-bce0-4a1b-b089-984f11ece80c tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:28.412438 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-96ecc252-bce0-4a1b-b089-984f11ece80c tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:28.419457 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-96ecc252-bce0-4a1b-b089-984f11ece80c tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:28.419896 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-96ecc252-bce0-4a1b-b089-984f11ece80c tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:28.420666 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-96ecc252-bce0-4a1b-b089-984f11ece80c tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:28.421092 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-96ecc252-bce0-4a1b-b089-984f11ece80c tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:28.565030 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-96ecc252-bce0-4a1b-b089-984f11ece80c tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:28.573290 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-96ecc252-bce0-4a1b-b089-984f11ece80c tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1358 microversion: 2.1 time: 0.167290 May 10 21:23:28.574279 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 218/426] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:28 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:29.172935 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-3750dea4-87c8-4d84-88ad-d298e5bf4a62 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:29.173625 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-3750dea4-87c8-4d84-88ad-d298e5bf4a62 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:29.180728 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3750dea4-87c8-4d84-88ad-d298e5bf4a62 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:29.181178 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3750dea4-87c8-4d84-88ad-d298e5bf4a62 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:29.181951 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3750dea4-87c8-4d84-88ad-d298e5bf4a62 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:29.182380 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3750dea4-87c8-4d84-88ad-d298e5bf4a62 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:29.321509 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-3750dea4-87c8-4d84-88ad-d298e5bf4a62 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:29.333370 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-3750dea4-87c8-4d84-88ad-d298e5bf4a62 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:29.334931 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-3750dea4-87c8-4d84-88ad-d298e5bf4a62 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:29.336068 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-3750dea4-87c8-4d84-88ad-d298e5bf4a62 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1808 microversion: 2.20 time: 0.167414 May 10 21:23:29.336638 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 209/427] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:23:29 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:23:29.591552 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-c497ae0a-cf1d-4cab-bb4d-249416e12d22 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:29.592280 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-c497ae0a-cf1d-4cab-bb4d-249416e12d22 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:29.599728 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c497ae0a-cf1d-4cab-bb4d-249416e12d22 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:29.600433 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c497ae0a-cf1d-4cab-bb4d-249416e12d22 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:29.601215 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c497ae0a-cf1d-4cab-bb4d-249416e12d22 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:29.605197 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c497ae0a-cf1d-4cab-bb4d-249416e12d22 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:29.741726 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-c497ae0a-cf1d-4cab-bb4d-249416e12d22 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:29.748984 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-c497ae0a-cf1d-4cab-bb4d-249416e12d22 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1358 microversion: 2.1 time: 0.161423 May 10 21:23:29.749551 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 219/428] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:29 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:30.356377 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-7d730bd1-d0cb-493c-8d3c-4e4675d6d811 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:30.356992 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-7d730bd1-d0cb-493c-8d3c-4e4675d6d811 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:30.363587 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7d730bd1-d0cb-493c-8d3c-4e4675d6d811 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:30.364034 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7d730bd1-d0cb-493c-8d3c-4e4675d6d811 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:30.364799 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7d730bd1-d0cb-493c-8d3c-4e4675d6d811 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:30.365234 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7d730bd1-d0cb-493c-8d3c-4e4675d6d811 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:30.501977 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-7d730bd1-d0cb-493c-8d3c-4e4675d6d811 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:30.511048 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-7d730bd1-d0cb-493c-8d3c-4e4675d6d811 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:30.512569 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-7d730bd1-d0cb-493c-8d3c-4e4675d6d811 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:30.513755 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-7d730bd1-d0cb-493c-8d3c-4e4675d6d811 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1808 microversion: 2.20 time: 0.161293 May 10 21:23:30.514483 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 210/429] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:23:30 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:23:30.766008 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-74141ef7-3585-43af-ab84-d1fb192b11a9 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:30.767821 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-74141ef7-3585-43af-ab84-d1fb192b11a9 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:30.775141 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-74141ef7-3585-43af-ab84-d1fb192b11a9 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:30.775582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-74141ef7-3585-43af-ab84-d1fb192b11a9 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:30.776404 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-74141ef7-3585-43af-ab84-d1fb192b11a9 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:30.776902 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-74141ef7-3585-43af-ab84-d1fb192b11a9 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:30.919827 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-74141ef7-3585-43af-ab84-d1fb192b11a9 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:30.927501 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-74141ef7-3585-43af-ab84-d1fb192b11a9 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1358 microversion: 2.1 time: 0.165353 May 10 21:23:30.928094 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 220/430] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:30 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:31.532322 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-c855ed54-944c-4e41-bd1c-27ab2f949dfc tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:31.533012 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-c855ed54-944c-4e41-bd1c-27ab2f949dfc tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:31.540371 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c855ed54-944c-4e41-bd1c-27ab2f949dfc tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:31.540819 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c855ed54-944c-4e41-bd1c-27ab2f949dfc tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:31.541593 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c855ed54-944c-4e41-bd1c-27ab2f949dfc tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:31.542027 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c855ed54-944c-4e41-bd1c-27ab2f949dfc tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:31.684588 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-c855ed54-944c-4e41-bd1c-27ab2f949dfc tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:31.693314 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-c855ed54-944c-4e41-bd1c-27ab2f949dfc tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:31.694951 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-c855ed54-944c-4e41-bd1c-27ab2f949dfc tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:31.696218 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-c855ed54-944c-4e41-bd1c-27ab2f949dfc tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1808 microversion: 2.20 time: 0.167861 May 10 21:23:31.696845 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 211/431] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:23:31 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:23:31.944844 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-3208ba9f-dbc6-462b-805e-ba3e51d9eaf1 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:31.945452 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-3208ba9f-dbc6-462b-805e-ba3e51d9eaf1 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:31.952289 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3208ba9f-dbc6-462b-805e-ba3e51d9eaf1 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:31.952741 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3208ba9f-dbc6-462b-805e-ba3e51d9eaf1 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:31.953523 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3208ba9f-dbc6-462b-805e-ba3e51d9eaf1 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:31.953955 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3208ba9f-dbc6-462b-805e-ba3e51d9eaf1 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:32.086768 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-3208ba9f-dbc6-462b-805e-ba3e51d9eaf1 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:32.094131 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-3208ba9f-dbc6-462b-805e-ba3e51d9eaf1 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1358 microversion: 2.1 time: 0.153273 May 10 21:23:32.094727 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 221/432] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:31 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:32.716128 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-0fcaf30f-6893-4809-8758-d58655d10bdc tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:32.716849 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-0fcaf30f-6893-4809-8758-d58655d10bdc tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:32.725551 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0fcaf30f-6893-4809-8758-d58655d10bdc tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:32.726021 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0fcaf30f-6893-4809-8758-d58655d10bdc tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:32.726795 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0fcaf30f-6893-4809-8758-d58655d10bdc tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:32.727226 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0fcaf30f-6893-4809-8758-d58655d10bdc tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:32.869177 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-0fcaf30f-6893-4809-8758-d58655d10bdc tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:32.882472 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-0fcaf30f-6893-4809-8758-d58655d10bdc tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:32.882472 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-0fcaf30f-6893-4809-8758-d58655d10bdc tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:32.882472 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-0fcaf30f-6893-4809-8758-d58655d10bdc tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1808 microversion: 2.20 time: 0.169507 May 10 21:23:32.884953 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 212/433] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:23:32 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:23:33.120755 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-07244171-ac6c-4d6d-b205-c9d16322ed50 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:33.121578 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-07244171-ac6c-4d6d-b205-c9d16322ed50 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:33.128307 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-07244171-ac6c-4d6d-b205-c9d16322ed50 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:33.128836 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-07244171-ac6c-4d6d-b205-c9d16322ed50 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:33.129629 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-07244171-ac6c-4d6d-b205-c9d16322ed50 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:33.130136 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-07244171-ac6c-4d6d-b205-c9d16322ed50 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:33.271145 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-07244171-ac6c-4d6d-b205-c9d16322ed50 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:33.279577 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-07244171-ac6c-4d6d-b205-c9d16322ed50 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1358 microversion: 2.1 time: 0.162443 May 10 21:23:33.285753 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 222/434] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:33 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:33.900358 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e941b332-c862-47ba-82f2-0a9fbdfa1ba9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:33.901085 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-e941b332-c862-47ba-82f2-0a9fbdfa1ba9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:33.907630 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e941b332-c862-47ba-82f2-0a9fbdfa1ba9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:33.908178 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e941b332-c862-47ba-82f2-0a9fbdfa1ba9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:33.909788 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e941b332-c862-47ba-82f2-0a9fbdfa1ba9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:33.910374 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e941b332-c862-47ba-82f2-0a9fbdfa1ba9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:34.042327 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-e941b332-c862-47ba-82f2-0a9fbdfa1ba9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:34.051069 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-e941b332-c862-47ba-82f2-0a9fbdfa1ba9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:34.052598 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-e941b332-c862-47ba-82f2-0a9fbdfa1ba9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:34.053789 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-e941b332-c862-47ba-82f2-0a9fbdfa1ba9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1808 microversion: 2.20 time: 0.157500 May 10 21:23:34.054363 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 213/435] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:23:33 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:23:34.075818 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-43f58f28-579a-4923-b8e7-01b06f9076e3 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "505c516f-42bc-4978-a113-aee2198b7892"}} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:23:34.076900 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-43f58f28-579a-4923-b8e7-01b06f9076e3 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:34.083100 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-43f58f28-579a-4923-b8e7-01b06f9076e3 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:34.083641 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-43f58f28-579a-4923-b8e7-01b06f9076e3 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:34.084443 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-43f58f28-579a-4923-b8e7-01b06f9076e3 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:34.084878 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-43f58f28-579a-4923-b8e7-01b06f9076e3 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:34.297883 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-ceeff97f-3a2c-4685-975a-7215d832dfaf tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:34.298515 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-ceeff97f-3a2c-4685-975a-7215d832dfaf tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:34.305900 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ceeff97f-3a2c-4685-975a-7215d832dfaf tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:34.306354 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ceeff97f-3a2c-4685-975a-7215d832dfaf tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:34.307157 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ceeff97f-3a2c-4685-975a-7215d832dfaf tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:34.307586 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ceeff97f-3a2c-4685-975a-7215d832dfaf tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:34.451589 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-ceeff97f-3a2c-4685-975a-7215d832dfaf tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:34.459968 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-ceeff97f-3a2c-4685-975a-7215d832dfaf tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1358 microversion: 2.1 time: 0.165821 May 10 21:23:34.460763 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 214/436] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:34 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:23:35.073516 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-c5cf433c-2112-4bc9-975d-15e050a283f9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:35.074164 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-c5cf433c-2112-4bc9-975d-15e050a283f9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:35.081565 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c5cf433c-2112-4bc9-975d-15e050a283f9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:35.082094 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c5cf433c-2112-4bc9-975d-15e050a283f9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:35.083196 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c5cf433c-2112-4bc9-975d-15e050a283f9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:35.083850 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c5cf433c-2112-4bc9-975d-15e050a283f9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:35.233354 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-c5cf433c-2112-4bc9-975d-15e050a283f9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:35.242702 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-c5cf433c-2112-4bc9-975d-15e050a283f9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:35.244219 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-c5cf433c-2112-4bc9-975d-15e050a283f9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:35.245388 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-c5cf433c-2112-4bc9-975d-15e050a283f9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1808 microversion: 2.20 time: 0.175934 May 10 21:23:35.246327 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 215/437] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:23:35 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:23:35.477939 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-cd4ac6d4-f2ca-4add-836f-72384fd74980 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:35.478584 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-cd4ac6d4-f2ca-4add-836f-72384fd74980 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:35.484687 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cd4ac6d4-f2ca-4add-836f-72384fd74980 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:35.485127 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cd4ac6d4-f2ca-4add-836f-72384fd74980 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:35.485970 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cd4ac6d4-f2ca-4add-836f-72384fd74980 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:35.486426 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cd4ac6d4-f2ca-4add-836f-72384fd74980 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:35.620464 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-cd4ac6d4-f2ca-4add-836f-72384fd74980 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:35.628589 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-cd4ac6d4-f2ca-4add-836f-72384fd74980 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1358 microversion: 2.1 time: 0.154552 May 10 21:23:35.629191 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 216/438] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:35 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:23:36.265071 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-390fcc88-0ce5-446c-b811-3cbc9fcd0e05 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:36.265729 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-390fcc88-0ce5-446c-b811-3cbc9fcd0e05 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:36.271962 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-390fcc88-0ce5-446c-b811-3cbc9fcd0e05 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:36.272397 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-390fcc88-0ce5-446c-b811-3cbc9fcd0e05 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:36.273152 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-390fcc88-0ce5-446c-b811-3cbc9fcd0e05 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:36.273576 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-390fcc88-0ce5-446c-b811-3cbc9fcd0e05 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:36.511022 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-390fcc88-0ce5-446c-b811-3cbc9fcd0e05 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:36.520307 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-390fcc88-0ce5-446c-b811-3cbc9fcd0e05 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:36.521871 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-390fcc88-0ce5-446c-b811-3cbc9fcd0e05 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:36.523079 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-390fcc88-0ce5-446c-b811-3cbc9fcd0e05 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1808 microversion: 2.20 time: 0.261885 May 10 21:23:36.527389 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 217/439] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:23:36 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1808 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:23:36.645168 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-14732a23-e467-4ecb-9581-78a004b47e60 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:36.645775 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-14732a23-e467-4ecb-9581-78a004b47e60 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:36.651605 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-14732a23-e467-4ecb-9581-78a004b47e60 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:36.652046 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-14732a23-e467-4ecb-9581-78a004b47e60 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:36.652798 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-14732a23-e467-4ecb-9581-78a004b47e60 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:36.653221 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-14732a23-e467-4ecb-9581-78a004b47e60 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:36.848732 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-14732a23-e467-4ecb-9581-78a004b47e60 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:36.863517 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-14732a23-e467-4ecb-9581-78a004b47e60 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1358 microversion: 2.1 time: 0.219509 May 10 21:23:36.863517 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 218/440] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:36 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:23:37.138478 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-d4bfbf8d-2ba1-4f76-866d-f03a0d565cee req-32a24f72-8de6-4b7c-92dc-89f38bc6f5e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4f87d15-87fb-4ada-8b58-6fa220505241", "tag": "00f67420-6c95-4cc5-8544-bceeed674619"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:23:37.138478 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-d4bfbf8d-2ba1-4f76-866d-f03a0d565cee req-32a24f72-8de6-4b7c-92dc-89f38bc6f5e2 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:37.138478 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-d4bfbf8d-2ba1-4f76-866d-f03a0d565cee req-32a24f72-8de6-4b7c-92dc-89f38bc6f5e2 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:37.149540 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-d4bfbf8d-2ba1-4f76-866d-f03a0d565cee req-32a24f72-8de6-4b7c-92dc-89f38bc6f5e2 service nova] Creating event network-changed:00f67420-6c95-4cc5-8544-bceeed674619 for instance c4f87d15-87fb-4ada-8b58-6fa220505241 on hv-cinder-83608 May 10 21:23:37.154810 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-d4bfbf8d-2ba1-4f76-866d-f03a0d565cee req-32a24f72-8de6-4b7c-92dc-89f38bc6f5e2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032130 May 10 21:23:37.155416 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 219/441] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:23:37.543854 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-aca34ba6-2956-44e1-8b0f-8458f8416776 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:37.544668 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-aca34ba6-2956-44e1-8b0f-8458f8416776 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:37.557965 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-aca34ba6-2956-44e1-8b0f-8458f8416776 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:37.563251 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-aca34ba6-2956-44e1-8b0f-8458f8416776 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:37.563251 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-aca34ba6-2956-44e1-8b0f-8458f8416776 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:37.563251 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-aca34ba6-2956-44e1-8b0f-8458f8416776 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:37.682841 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-43f58f28-579a-4923-b8e7-01b06f9076e3 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "POST /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.610499 May 10 21:23:37.683342 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 223/442] 10.222.0.25 () {60 vars in 1322 bytes} [Tue May 10 21:23:34 2022] POST /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab/os-volume_attachments => generated 194 bytes in 3612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:23:37.809801 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-aca34ba6-2956-44e1-8b0f-8458f8416776 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:37.818838 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-aca34ba6-2956-44e1-8b0f-8458f8416776 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:37.820364 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-aca34ba6-2956-44e1-8b0f-8458f8416776 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:37.821512 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-aca34ba6-2956-44e1-8b0f-8458f8416776 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1808 microversion: 2.20 time: 0.282509 May 10 21:23:37.822068 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 220/443] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:23:37 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1808 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:23:37.877615 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-dc8f6efe-7a95-4ec9-a5ad-065acb89fb25 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:37.878936 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-dc8f6efe-7a95-4ec9-a5ad-065acb89fb25 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:37.886151 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-dc8f6efe-7a95-4ec9-a5ad-065acb89fb25 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:37.886854 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-dc8f6efe-7a95-4ec9-a5ad-065acb89fb25 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:37.887924 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-dc8f6efe-7a95-4ec9-a5ad-065acb89fb25 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:37.888512 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-dc8f6efe-7a95-4ec9-a5ad-065acb89fb25 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:38.020220 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-dc8f6efe-7a95-4ec9-a5ad-065acb89fb25 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:38.027811 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-dc8f6efe-7a95-4ec9-a5ad-065acb89fb25 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1358 microversion: 2.1 time: 0.154435 May 10 21:23:38.028372 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 224/444] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:37 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:38.839997 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6478a98c-311c-49f3-8fc9-efec1baf1730 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:38.840792 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-6478a98c-311c-49f3-8fc9-efec1baf1730 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:38.847955 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6478a98c-311c-49f3-8fc9-efec1baf1730 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:38.848397 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6478a98c-311c-49f3-8fc9-efec1baf1730 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:38.849170 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6478a98c-311c-49f3-8fc9-efec1baf1730 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:38.849775 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6478a98c-311c-49f3-8fc9-efec1baf1730 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:38.982777 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-6478a98c-311c-49f3-8fc9-efec1baf1730 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:38.991664 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-6478a98c-311c-49f3-8fc9-efec1baf1730 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:38.993162 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-6478a98c-311c-49f3-8fc9-efec1baf1730 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:38.994308 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-6478a98c-311c-49f3-8fc9-efec1baf1730 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1808 microversion: 2.20 time: 0.158271 May 10 21:23:38.994910 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 221/445] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:23:38 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:23:39.044822 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-513d14f8-b9fe-40cf-b299-90a693561de5 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:39.045406 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-513d14f8-b9fe-40cf-b299-90a693561de5 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:39.051996 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-513d14f8-b9fe-40cf-b299-90a693561de5 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:39.052438 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-513d14f8-b9fe-40cf-b299-90a693561de5 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:39.056164 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-513d14f8-b9fe-40cf-b299-90a693561de5 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:39.056164 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-513d14f8-b9fe-40cf-b299-90a693561de5 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:39.181144 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-513d14f8-b9fe-40cf-b299-90a693561de5 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:39.188508 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-513d14f8-b9fe-40cf-b299-90a693561de5 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1358 microversion: 2.1 time: 0.147457 May 10 21:23:39.189089 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 225/446] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:39 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:40.013316 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-081d1218-5775-49c2-881f-c3675717140f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:40.013925 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-081d1218-5775-49c2-881f-c3675717140f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:40.020384 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-081d1218-5775-49c2-881f-c3675717140f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:40.020833 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-081d1218-5775-49c2-881f-c3675717140f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:40.021598 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-081d1218-5775-49c2-881f-c3675717140f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:40.022030 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-081d1218-5775-49c2-881f-c3675717140f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:40.149275 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-081d1218-5775-49c2-881f-c3675717140f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:40.157556 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-081d1218-5775-49c2-881f-c3675717140f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:40.159630 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-081d1218-5775-49c2-881f-c3675717140f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:40.160773 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-081d1218-5775-49c2-881f-c3675717140f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1808 microversion: 2.20 time: 0.151373 May 10 21:23:40.161339 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 222/447] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:23:40 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:23:40.204949 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-7b6efc9a-789b-43f4-9163-35015775dd7d tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:40.205557 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-7b6efc9a-789b-43f4-9163-35015775dd7d tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:40.212069 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7b6efc9a-789b-43f4-9163-35015775dd7d tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:40.212511 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7b6efc9a-789b-43f4-9163-35015775dd7d tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:40.213267 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7b6efc9a-789b-43f4-9163-35015775dd7d tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:40.213691 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7b6efc9a-789b-43f4-9163-35015775dd7d tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:40.342836 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-7b6efc9a-789b-43f4-9163-35015775dd7d tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:40.350626 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-7b6efc9a-789b-43f4-9163-35015775dd7d tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1358 microversion: 2.1 time: 0.149472 May 10 21:23:40.351130 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 226/448] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:40 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:40.879578 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-7d601325-2909-43ae-82a3-0727579633ea req-977db2cf-790c-4638-894f-969b2f9b18ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef19cfc2-aeb2-40ff-b25c-187304690869", "name": "network-vif-plugged", "status": "completed", "tag": "83ef924d-2caa-4d5a-8fb2-cd0a871c9712"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:23:40.888172 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-7d601325-2909-43ae-82a3-0727579633ea req-977db2cf-790c-4638-894f-969b2f9b18ca service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:40.888607 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-7d601325-2909-43ae-82a3-0727579633ea req-977db2cf-790c-4638-894f-969b2f9b18ca service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:40.902139 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-7d601325-2909-43ae-82a3-0727579633ea req-977db2cf-790c-4638-894f-969b2f9b18ca service nova] Creating event network-vif-plugged:83ef924d-2caa-4d5a-8fb2-cd0a871c9712 for instance ef19cfc2-aeb2-40ff-b25c-187304690869 on hv-cinder-83608 May 10 21:23:40.907394 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-7d601325-2909-43ae-82a3-0727579633ea req-977db2cf-790c-4638-894f-969b2f9b18ca service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032312 May 10 21:23:40.914415 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 223/449] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:23:41.179762 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-ec91adfb-b6a4-4bd2-94ef-ea79ad65687a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:41.180364 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-ec91adfb-b6a4-4bd2-94ef-ea79ad65687a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:41.186396 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ec91adfb-b6a4-4bd2-94ef-ea79ad65687a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:41.186863 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ec91adfb-b6a4-4bd2-94ef-ea79ad65687a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:41.187614 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ec91adfb-b6a4-4bd2-94ef-ea79ad65687a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:41.188059 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ec91adfb-b6a4-4bd2-94ef-ea79ad65687a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:41.315444 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-ec91adfb-b6a4-4bd2-94ef-ea79ad65687a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:41.323866 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-ec91adfb-b6a4-4bd2-94ef-ea79ad65687a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:41.325488 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-ec91adfb-b6a4-4bd2-94ef-ea79ad65687a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:41.326953 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-ec91adfb-b6a4-4bd2-94ef-ea79ad65687a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1808 microversion: 2.20 time: 0.151320 May 10 21:23:41.327596 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 227/450] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:23:41 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:23:41.368030 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6f4f72f5-d4ed-413a-8683-c66dc1d39be8 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:41.368719 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-6f4f72f5-d4ed-413a-8683-c66dc1d39be8 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:41.374733 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6f4f72f5-d4ed-413a-8683-c66dc1d39be8 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:41.375171 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6f4f72f5-d4ed-413a-8683-c66dc1d39be8 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:41.375928 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6f4f72f5-d4ed-413a-8683-c66dc1d39be8 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:41.376349 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6f4f72f5-d4ed-413a-8683-c66dc1d39be8 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:41.509836 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-6f4f72f5-d4ed-413a-8683-c66dc1d39be8 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:41.517172 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-6f4f72f5-d4ed-413a-8683-c66dc1d39be8 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1358 microversion: 2.1 time: 0.153677 May 10 21:23:41.517674 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 224/451] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:41 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:42.345642 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-a4f5bdab-5fd8-442f-9769-2da8b08d355f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:42.346257 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-a4f5bdab-5fd8-442f-9769-2da8b08d355f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:42.353145 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-a4f5bdab-5fd8-442f-9769-2da8b08d355f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:42.353593 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-a4f5bdab-5fd8-442f-9769-2da8b08d355f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:42.354358 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-a4f5bdab-5fd8-442f-9769-2da8b08d355f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:42.354820 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-a4f5bdab-5fd8-442f-9769-2da8b08d355f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:42.481221 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-a4f5bdab-5fd8-442f-9769-2da8b08d355f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:42.490183 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-a4f5bdab-5fd8-442f-9769-2da8b08d355f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:42.491698 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-a4f5bdab-5fd8-442f-9769-2da8b08d355f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:42.492831 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-a4f5bdab-5fd8-442f-9769-2da8b08d355f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1808 microversion: 2.20 time: 0.151117 May 10 21:23:42.493393 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 228/452] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:23:42 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:23:42.534730 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4e6f8773-5c62-4b6a-bc97-c35ba8aa81f0 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:42.535338 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-4e6f8773-5c62-4b6a-bc97-c35ba8aa81f0 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:42.541592 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4e6f8773-5c62-4b6a-bc97-c35ba8aa81f0 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:42.542025 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4e6f8773-5c62-4b6a-bc97-c35ba8aa81f0 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:42.542807 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4e6f8773-5c62-4b6a-bc97-c35ba8aa81f0 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:42.543236 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4e6f8773-5c62-4b6a-bc97-c35ba8aa81f0 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:42.668497 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-4e6f8773-5c62-4b6a-bc97-c35ba8aa81f0 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:42.677129 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4e6f8773-5c62-4b6a-bc97-c35ba8aa81f0 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1358 microversion: 2.1 time: 0.146608 May 10 21:23:42.677704 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 225/453] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:42 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:42.933796 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-221de696-1fa9-4d37-a14f-e9d9f1d6bcfc req-ff7e7048-7b9e-4dc0-9111-8deef3f431a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4f87d15-87fb-4ada-8b58-6fa220505241", "name": "network-vif-plugged", "status": "completed", "tag": "00f67420-6c95-4cc5-8544-bceeed674619"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:23:42.942041 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-221de696-1fa9-4d37-a14f-e9d9f1d6bcfc req-ff7e7048-7b9e-4dc0-9111-8deef3f431a7 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:42.942836 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-221de696-1fa9-4d37-a14f-e9d9f1d6bcfc req-ff7e7048-7b9e-4dc0-9111-8deef3f431a7 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:42.953221 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-221de696-1fa9-4d37-a14f-e9d9f1d6bcfc req-ff7e7048-7b9e-4dc0-9111-8deef3f431a7 service nova] Creating event network-vif-plugged:00f67420-6c95-4cc5-8544-bceeed674619 for instance c4f87d15-87fb-4ada-8b58-6fa220505241 on hv-cinder-83608 May 10 21:23:42.958994 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-221de696-1fa9-4d37-a14f-e9d9f1d6bcfc req-ff7e7048-7b9e-4dc0-9111-8deef3f431a7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028834 May 10 21:23:42.959957 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 229/454] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:23:43.511470 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-868293e7-7236-4edf-b288-106a6bdf8958 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:43.512083 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-868293e7-7236-4edf-b288-106a6bdf8958 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:43.518139 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-868293e7-7236-4edf-b288-106a6bdf8958 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:43.518621 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-868293e7-7236-4edf-b288-106a6bdf8958 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:43.519541 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-868293e7-7236-4edf-b288-106a6bdf8958 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:43.520052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-868293e7-7236-4edf-b288-106a6bdf8958 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:43.695538 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-9579c225-eb71-403f-99f5-dd839faed862 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:43.698693 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-9579c225-eb71-403f-99f5-dd839faed862 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:43.699140 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-868293e7-7236-4edf-b288-106a6bdf8958 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:43.704772 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9579c225-eb71-403f-99f5-dd839faed862 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:43.708694 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9579c225-eb71-403f-99f5-dd839faed862 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:43.708694 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9579c225-eb71-403f-99f5-dd839faed862 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:43.708694 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9579c225-eb71-403f-99f5-dd839faed862 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:43.708983 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-868293e7-7236-4edf-b288-106a6bdf8958 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:43.709498 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-868293e7-7236-4edf-b288-106a6bdf8958 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:43.710694 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-868293e7-7236-4edf-b288-106a6bdf8958 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1808 microversion: 2.20 time: 0.203460 May 10 21:23:43.711453 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 226/455] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:23:43 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1808 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:23:43.839415 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-9579c225-eb71-403f-99f5-dd839faed862 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:43.848250 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-9579c225-eb71-403f-99f5-dd839faed862 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1358 microversion: 2.1 time: 0.158047 May 10 21:23:43.848842 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 230/456] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:43 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:23:44.728900 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e8337c79-caa5-45b3-9d5c-b2af09840acd tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:44.729490 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-e8337c79-caa5-45b3-9d5c-b2af09840acd tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:44.735768 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e8337c79-caa5-45b3-9d5c-b2af09840acd tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:44.736212 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e8337c79-caa5-45b3-9d5c-b2af09840acd tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:44.736960 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e8337c79-caa5-45b3-9d5c-b2af09840acd tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:44.737383 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e8337c79-caa5-45b3-9d5c-b2af09840acd tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:44.865219 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-12f99ce0-5ed0-461d-b721-8ac71c709ac4 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:44.866056 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-12f99ce0-5ed0-461d-b721-8ac71c709ac4 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:44.871764 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-e8337c79-caa5-45b3-9d5c-b2af09840acd tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:44.872394 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-12f99ce0-5ed0-461d-b721-8ac71c709ac4 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:44.872838 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-12f99ce0-5ed0-461d-b721-8ac71c709ac4 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:44.873599 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-12f99ce0-5ed0-461d-b721-8ac71c709ac4 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:44.874024 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-12f99ce0-5ed0-461d-b721-8ac71c709ac4 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:44.883301 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-e8337c79-caa5-45b3-9d5c-b2af09840acd tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:44.884799 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-e8337c79-caa5-45b3-9d5c-b2af09840acd tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:44.885962 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-e8337c79-caa5-45b3-9d5c-b2af09840acd tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1808 microversion: 2.20 time: 0.160988 May 10 21:23:44.886575 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 227/457] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:23:44 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:23:45.002238 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-12f99ce0-5ed0-461d-b721-8ac71c709ac4 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:45.010542 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-12f99ce0-5ed0-461d-b721-8ac71c709ac4 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1358 microversion: 2.1 time: 0.149288 May 10 21:23:45.011122 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 231/458] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:44 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:23:45.908133 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-dca7bb26-be3a-4a79-b72c-d41ed71faa73 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:45.908770 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-dca7bb26-be3a-4a79-b72c-d41ed71faa73 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:45.915457 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dca7bb26-be3a-4a79-b72c-d41ed71faa73 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:45.916416 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dca7bb26-be3a-4a79-b72c-d41ed71faa73 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:45.917803 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dca7bb26-be3a-4a79-b72c-d41ed71faa73 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:45.918247 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dca7bb26-be3a-4a79-b72c-d41ed71faa73 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:46.027439 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-573ba9ee-4348-4e8b-b8ad-eb64c66933b4 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:46.028041 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-573ba9ee-4348-4e8b-b8ad-eb64c66933b4 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:46.035269 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-573ba9ee-4348-4e8b-b8ad-eb64c66933b4 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:46.039497 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-573ba9ee-4348-4e8b-b8ad-eb64c66933b4 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:46.039497 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-573ba9ee-4348-4e8b-b8ad-eb64c66933b4 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:46.039497 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-573ba9ee-4348-4e8b-b8ad-eb64c66933b4 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:46.052877 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-dca7bb26-be3a-4a79-b72c-d41ed71faa73 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:46.061140 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-dca7bb26-be3a-4a79-b72c-d41ed71faa73 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:46.065008 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-dca7bb26-be3a-4a79-b72c-d41ed71faa73 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:46.065008 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-dca7bb26-be3a-4a79-b72c-d41ed71faa73 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1795 microversion: 2.20 time: 0.162016 May 10 21:23:46.065008 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 228/459] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:23:45 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1795 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:23:46.169719 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-573ba9ee-4348-4e8b-b8ad-eb64c66933b4 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:46.177947 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-573ba9ee-4348-4e8b-b8ad-eb64c66933b4 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1548 microversion: 2.1 time: 0.154420 May 10 21:23:46.178575 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 232/460] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:46 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:23:46.193696 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-faf79533-5fe3-43f9-8312-5d6896a0f65a tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:46.194314 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-faf79533-5fe3-43f9-8312-5d6896a0f65a tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:46.200268 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-faf79533-5fe3-43f9-8312-5d6896a0f65a tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:46.200718 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-faf79533-5fe3-43f9-8312-5d6896a0f65a tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:46.201530 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-faf79533-5fe3-43f9-8312-5d6896a0f65a tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:46.201967 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-faf79533-5fe3-43f9-8312-5d6896a0f65a tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:46.330420 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-faf79533-5fe3-43f9-8312-5d6896a0f65a tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:46.337722 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-faf79533-5fe3-43f9-8312-5d6896a0f65a tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1548 microversion: 2.1 time: 0.147877 May 10 21:23:46.338284 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 229/461] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:46 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:46.353347 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-8377a918-1e27-4fb8-b6ed-5a7e0bb53435 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:46.356747 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-8377a918-1e27-4fb8-b6ed-5a7e0bb53435 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:46.357503 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-8377a918-1e27-4fb8-b6ed-5a7e0bb53435 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Searching by: {'deleted': False, 'project_id': '7858ff72ee9843a493c27f9592a540b0'} {{(pid=117678) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 21:23:46.364842 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8377a918-1e27-4fb8-b6ed-5a7e0bb53435 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:46.365217 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8377a918-1e27-4fb8-b6ed-5a7e0bb53435 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:46.366041 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8377a918-1e27-4fb8-b6ed-5a7e0bb53435 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:46.366488 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8377a918-1e27-4fb8-b6ed-5a7e0bb53435 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:46.457801 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.multi_cell_list [None req-8377a918-1e27-4fb8-b6ed-5a7e0bb53435 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117678) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 21:23:46.551793 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-8377a918-1e27-4fb8-b6ed-5a7e0bb53435 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.202065 May 10 21:23:46.552386 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 233/462] 10.222.0.25 () {58 vars in 1124 bytes} [Tue May 10 21:23:46 2022] GET /compute/v2.1/servers => generated 342 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:23:46.562210 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-196983b9-c1de-44d3-8d08-bd3417719666 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:46.565477 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-196983b9-c1de-44d3-8d08-bd3417719666 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:46.568844 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-196983b9-c1de-44d3-8d08-bd3417719666 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:46.569281 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-196983b9-c1de-44d3-8d08-bd3417719666 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:46.570027 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-196983b9-c1de-44d3-8d08-bd3417719666 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:46.570468 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-196983b9-c1de-44d3-8d08-bd3417719666 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:46.700381 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-196983b9-c1de-44d3-8d08-bd3417719666 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:46.708600 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-196983b9-c1de-44d3-8d08-bd3417719666 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1548 microversion: 2.1 time: 0.150108 May 10 21:23:46.709164 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 230/463] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:46 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:47.271853 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-1e53e8c2-8199-4dc0-ba79-02eed69a0bad tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:23:47.272797 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-1e53e8c2-8199-4dc0-ba79-02eed69a0bad tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:47.279342 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1e53e8c2-8199-4dc0-ba79-02eed69a0bad tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:47.279787 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1e53e8c2-8199-4dc0-ba79-02eed69a0bad tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:47.280545 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1e53e8c2-8199-4dc0-ba79-02eed69a0bad tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:47.281004 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1e53e8c2-8199-4dc0-ba79-02eed69a0bad tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:47.305510 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.objects.instance [None req-1e53e8c2-8199-4dc0-ba79-02eed69a0bad tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lazy-loading 'flavor' on Instance uuid e6abd4e9-f5fd-4413-9d26-808c47d618ab {{(pid=117678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:23:47.637093 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-1e53e8c2-8199-4dc0-ba79-02eed69a0bad tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "POST /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab/action" status: 200 len: 32 microversion: 2.1 time: 0.369773 May 10 21:23:47.637935 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 234/464] 10.222.0.25 () {60 vars in 1277 bytes} [Tue May 10 21:23:47 2022] POST /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab/action => generated 32 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 21:23:47.647338 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a3d7f881-b4ad-4d6b-a9cb-fdf4088847c8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:47.648068 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-a3d7f881-b4ad-4d6b-a9cb-fdf4088847c8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:47.654598 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a3d7f881-b4ad-4d6b-a9cb-fdf4088847c8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:47.655048 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a3d7f881-b4ad-4d6b-a9cb-fdf4088847c8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:47.655817 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a3d7f881-b4ad-4d6b-a9cb-fdf4088847c8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:47.656252 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a3d7f881-b4ad-4d6b-a9cb-fdf4088847c8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:47.794823 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-a3d7f881-b4ad-4d6b-a9cb-fdf4088847c8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:47.803986 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-a3d7f881-b4ad-4d6b-a9cb-fdf4088847c8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1736 microversion: 2.1 time: 0.160739 May 10 21:23:47.804573 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 231/465] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:47 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:48.551094 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-222a3c5b-6944-482f-9256-26bb1cc0eea6 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27358427-528a-4112-bc13-bbf4a79810c6"}} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:23:48.552341 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-222a3c5b-6944-482f-9256-26bb1cc0eea6 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:48.558322 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-222a3c5b-6944-482f-9256-26bb1cc0eea6 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:48.558796 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-222a3c5b-6944-482f-9256-26bb1cc0eea6 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:48.559545 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-222a3c5b-6944-482f-9256-26bb1cc0eea6 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:48.559973 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-222a3c5b-6944-482f-9256-26bb1cc0eea6 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:48.821831 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-1254c8d1-95e3-4ed9-a211-96281f95cc02 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:48.822463 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-1254c8d1-95e3-4ed9-a211-96281f95cc02 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:48.829106 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1254c8d1-95e3-4ed9-a211-96281f95cc02 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:48.829548 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1254c8d1-95e3-4ed9-a211-96281f95cc02 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:48.830334 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1254c8d1-95e3-4ed9-a211-96281f95cc02 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:48.830983 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1254c8d1-95e3-4ed9-a211-96281f95cc02 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:48.963432 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1254c8d1-95e3-4ed9-a211-96281f95cc02 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:48.971407 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-1254c8d1-95e3-4ed9-a211-96281f95cc02 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1736 microversion: 2.1 time: 0.153416 May 10 21:23:48.971991 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 232/466] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:48 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:23:49.220334 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-222a3c5b-6944-482f-9256-26bb1cc0eea6 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "POST /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.673735 May 10 21:23:49.220953 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 235/467] 10.222.0.25 () {60 vars in 1322 bytes} [Tue May 10 21:23:48 2022] POST /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241/os-volume_attachments => generated 194 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:23:49.989264 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-0f64c122-9c47-4a32-9323-6f712ca8f356 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:49.989890 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-0f64c122-9c47-4a32-9323-6f712ca8f356 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:49.996224 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0f64c122-9c47-4a32-9323-6f712ca8f356 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:49.998933 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0f64c122-9c47-4a32-9323-6f712ca8f356 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:49.998933 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0f64c122-9c47-4a32-9323-6f712ca8f356 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:49.998933 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0f64c122-9c47-4a32-9323-6f712ca8f356 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:50.125081 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-0f64c122-9c47-4a32-9323-6f712ca8f356 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:50.134050 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-0f64c122-9c47-4a32-9323-6f712ca8f356 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1736 microversion: 2.1 time: 0.149601 May 10 21:23:50.134648 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 233/468] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:49 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:51.151785 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-e7d0ee2e-f439-49d6-9db4-6cacc1441a86 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:51.152498 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-e7d0ee2e-f439-49d6-9db4-6cacc1441a86 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:51.159161 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e7d0ee2e-f439-49d6-9db4-6cacc1441a86 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:51.159603 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e7d0ee2e-f439-49d6-9db4-6cacc1441a86 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:51.161025 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e7d0ee2e-f439-49d6-9db4-6cacc1441a86 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:51.161412 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e7d0ee2e-f439-49d6-9db4-6cacc1441a86 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:51.291495 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-e7d0ee2e-f439-49d6-9db4-6cacc1441a86 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:51.299197 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-e7d0ee2e-f439-49d6-9db4-6cacc1441a86 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1736 microversion: 2.1 time: 0.151629 May 10 21:23:51.299763 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 236/469] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:51 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:52.316827 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-1e993088-14e5-44d4-b61c-daca90bea22a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:52.317443 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-1e993088-14e5-44d4-b61c-daca90bea22a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:52.323856 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1e993088-14e5-44d4-b61c-daca90bea22a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:52.324297 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1e993088-14e5-44d4-b61c-daca90bea22a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:52.325055 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1e993088-14e5-44d4-b61c-daca90bea22a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:52.325485 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1e993088-14e5-44d4-b61c-daca90bea22a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:52.451506 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1e993088-14e5-44d4-b61c-daca90bea22a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:52.460047 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-1e993088-14e5-44d4-b61c-daca90bea22a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1736 microversion: 2.1 time: 0.147354 May 10 21:23:52.460609 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 234/470] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:52 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:53.477035 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-83d64ac8-239f-42a5-b6f8-46802b9c9f62 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:53.477638 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-83d64ac8-239f-42a5-b6f8-46802b9c9f62 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:53.483931 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-83d64ac8-239f-42a5-b6f8-46802b9c9f62 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:53.484369 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-83d64ac8-239f-42a5-b6f8-46802b9c9f62 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:53.485114 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-83d64ac8-239f-42a5-b6f8-46802b9c9f62 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:53.485541 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-83d64ac8-239f-42a5-b6f8-46802b9c9f62 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:53.614306 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-83d64ac8-239f-42a5-b6f8-46802b9c9f62 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:53.622107 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-83d64ac8-239f-42a5-b6f8-46802b9c9f62 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1736 microversion: 2.1 time: 0.148951 May 10 21:23:53.622711 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 237/471] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:53 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:54.639655 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-34969225-96a7-46d9-a8b6-b65f05b08adf tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:54.640255 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-34969225-96a7-46d9-a8b6-b65f05b08adf tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:54.647366 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-34969225-96a7-46d9-a8b6-b65f05b08adf tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:54.647807 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-34969225-96a7-46d9-a8b6-b65f05b08adf tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:54.648559 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-34969225-96a7-46d9-a8b6-b65f05b08adf tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:54.648986 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-34969225-96a7-46d9-a8b6-b65f05b08adf tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:54.776963 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-34969225-96a7-46d9-a8b6-b65f05b08adf tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:54.785116 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-34969225-96a7-46d9-a8b6-b65f05b08adf tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1736 microversion: 2.1 time: 0.149174 May 10 21:23:54.785838 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 235/472] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:54 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:55.802038 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-5e10bb7f-d60b-4dba-b721-303f7a416483 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:55.802608 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-5e10bb7f-d60b-4dba-b721-303f7a416483 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:55.808984 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5e10bb7f-d60b-4dba-b721-303f7a416483 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:55.809423 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5e10bb7f-d60b-4dba-b721-303f7a416483 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:55.810180 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5e10bb7f-d60b-4dba-b721-303f7a416483 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:55.810658 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5e10bb7f-d60b-4dba-b721-303f7a416483 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:55.942388 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-5e10bb7f-d60b-4dba-b721-303f7a416483 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:55.950151 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-5e10bb7f-d60b-4dba-b721-303f7a416483 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1736 microversion: 2.1 time: 0.152610 May 10 21:23:55.950763 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 238/473] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:55 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:56.967154 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-64e917c5-3b3b-4ccd-aac0-df270ce9cbf8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:56.967754 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-64e917c5-3b3b-4ccd-aac0-df270ce9cbf8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:56.974152 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-64e917c5-3b3b-4ccd-aac0-df270ce9cbf8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:56.974607 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-64e917c5-3b3b-4ccd-aac0-df270ce9cbf8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:56.975367 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-64e917c5-3b3b-4ccd-aac0-df270ce9cbf8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:56.975795 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-64e917c5-3b3b-4ccd-aac0-df270ce9cbf8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:57.105084 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-64e917c5-3b3b-4ccd-aac0-df270ce9cbf8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:57.112788 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-64e917c5-3b3b-4ccd-aac0-df270ce9cbf8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1736 microversion: 2.1 time: 0.149475 May 10 21:23:57.117323 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 236/474] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:56 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:57.803335 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-30341c75-1e30-48a7-a23c-936980682df0 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:57.803945 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-30341c75-1e30-48a7-a23c-936980682df0 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:57.810314 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-30341c75-1e30-48a7-a23c-936980682df0 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:57.810796 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-30341c75-1e30-48a7-a23c-936980682df0 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:57.811553 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-30341c75-1e30-48a7-a23c-936980682df0 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:57.811980 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-30341c75-1e30-48a7-a23c-936980682df0 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:57.941951 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-30341c75-1e30-48a7-a23c-936980682df0 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:57.949812 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-30341c75-1e30-48a7-a23c-936980682df0 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1594 microversion: 2.1 time: 0.151074 May 10 21:23:57.950639 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 239/475] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:57 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1594 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:58.106874 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-646b7e3d-6284-45b3-ab9b-7fcacbca5c37 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:58.107392 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-646b7e3d-6284-45b3-ab9b-7fcacbca5c37 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 362a9924-7119-4e2e-bd41-d68a5f545009] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:58.114033 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-646b7e3d-6284-45b3-ab9b-7fcacbca5c37 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:58.114398 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-646b7e3d-6284-45b3-ab9b-7fcacbca5c37 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:58.115197 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-646b7e3d-6284-45b3-ab9b-7fcacbca5c37 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:58.115630 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-646b7e3d-6284-45b3-ab9b-7fcacbca5c37 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:58.130793 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-c346e500-21f6-4532-ba9c-6d9058928528 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:58.131488 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-c346e500-21f6-4532-ba9c-6d9058928528 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:58.137830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c346e500-21f6-4532-ba9c-6d9058928528 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:58.138283 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c346e500-21f6-4532-ba9c-6d9058928528 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:58.139080 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c346e500-21f6-4532-ba9c-6d9058928528 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:58.139578 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c346e500-21f6-4532-ba9c-6d9058928528 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:58.140010 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-646b7e3d-6284-45b3-ab9b-7fcacbca5c37 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009/ips" status: 200 len: 151 microversion: 2.1 time: 0.037012 May 10 21:23:58.140593 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 237/476] 10.222.0.25 () {58 vars in 1247 bytes} [Tue May 10 21:23:58 2022] GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:23:58.152091 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-92006e4d-72a6-494e-83ca-9e62189a37c7 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "535e59b4-e36b-41e8-9eec-d0042c1bfca9"}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:23:58.153268 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-92006e4d-72a6-494e-83ca-9e62189a37c7 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 362a9924-7119-4e2e-bd41-d68a5f545009] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:58.160005 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-92006e4d-72a6-494e-83ca-9e62189a37c7 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:58.160005 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-92006e4d-72a6-494e-83ca-9e62189a37c7 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:58.172395 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-92006e4d-72a6-494e-83ca-9e62189a37c7 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:58.172395 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-92006e4d-72a6-494e-83ca-9e62189a37c7 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:58.244433 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-92006e4d-72a6-494e-83ca-9e62189a37c7 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] HTTP exception thrown: Invalid volume: volume 535e59b4-e36b-41e8-9eec-d0042c1bfca9 is already attached to instances: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2 May 10 21:23:58.246224 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-92006e4d-72a6-494e-83ca-9e62189a37c7 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Request method failure captured: May 10 21:23:58.246224 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: request: POST /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009/os-volume_attachments HTTP/1.1 May 10 21:23:58.246224 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept: application/json May 10 21:23:58.246224 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity May 10 21:23:58.246224 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Connection: close May 10 21:23:58.246224 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Length: 74 May 10 21:23:58.246224 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Type: application/json May 10 21:23:58.246224 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Host: 10.222.0.25 May 10 21:23:58.246224 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None May 10 21:23:58.246224 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 May 10 21:23:58.246224 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABietccfViYRiOQpEa4ldvOHZyUgOQ2ZBBatS9SA20GCDt_AgmFvo4vE33WkYc6oqnMaRFSIYJbwKR_AxZ5OfoHdxsDJwPaySjCJQ5rrDhZmJbbtmsjCkN_RYEyYX6qvdoHvFk_bXj7SkSAx705IP0l1sxFz6bBTFTgIB8EAyrOf7pHKV8 May 10 21:23:58.246224 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Id: None May 10 21:23:58.246224 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Name: None May 10 21:23:58.246224 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed May 10 21:23:58.246224 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True May 10 21:23:58.246224 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default May 10 21:23:58.246224 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default May 10 21:23:58.246224 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Id: 8286226c580f4896aec72c65642fce30 May 10 21:23:58.246224 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-AttachVolumeNegativeTest-1863330069 May 10 21:23:58.246224 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Role: member,reader May 10 21:23:58.246224 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Roles: member,reader May 10 21:23:58.247929 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8286226c580f4896aec72c65642fce30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8286226c580f4896aec72c65642fce30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8286226c580f4896aec72c65642fce30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8286226c580f4896aec72c65642fce30"}]}] May 10 21:23:58.247929 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-AttachVolumeNegativeTest-1863330069 May 10 21:23:58.247929 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Id: 8286226c580f4896aec72c65642fce30 May 10 21:23:58.247929 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1863330069 May 10 21:23:58.247929 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User: tempest-AttachVolumeNegativeTest-1863330069-project May 10 21:23:58.247929 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default May 10 21:23:58.247929 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default May 10 21:23:58.247929 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Id: ca39678abe6e476283f94c675d4ea369 May 10 21:23:58.247929 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-AttachVolumeNegativeTest-1863330069-project May 10 21:23:58.247929 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: May 10 21:23:58.247929 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: {"volumeAttachment": {"volumeId": "535e59b4-e36b-41e8-9eec-d0042c1bfca9"}} May 10 21:23:58.247929 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: method: > May 10 21:23:58.248931 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: exception: Invalid volume: volume 535e59b4-e36b-41e8-9eec-d0042c1bfca9 is already attached to instances: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2 May 10 21:23:58.248931 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: action_args: {'server_id': '362a9924-7119-4e2e-bd41-d68a5f545009', 'body': {'volumeAttachment': {'volumeId': '535e59b4-e36b-41e8-9eec-d0042c1bfca9'}}} May 10 21:23:58.248931 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:23:58.248931 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:23:58.248931 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 10 21:23:58.248931 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 10 21:23:58.248931 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 21:23:58.248931 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 21:23:58.248931 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 10 21:23:58.248931 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 21:23:58.248931 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 10 21:23:58.248931 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 10 21:23:58.248931 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 10 21:23:58.248931 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 10 21:23:58.248931 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 535e59b4-e36b-41e8-9eec-d0042c1bfca9 is already attached to instances: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2 May 10 21:23:58.248931 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:23:58.248931 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:23:58.248931 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:23:58.248931 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:23:58.250335 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:23:58.250335 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:23:58.250335 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:23:58.250335 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:23:58.250335 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:23:58.250335 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:23:58.250335 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 21:23:58.250335 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 21:23:58.250335 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 21:23:58.250335 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 21:23:58.250335 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 21:23:58.250335 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 21:23:58.250335 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 10 21:23:58.250335 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 10 21:23:58.250335 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 535e59b4-e36b-41e8-9eec-d0042c1bfca9 is already attached to instances: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2 May 10 21:23:58.250335 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:23:58.250335 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:23:58.250335 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:23:58.250335 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:23:58.250335 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:23:58.251895 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:23:58.251895 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:23:58.251895 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:23:58.251895 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 535e59b4-e36b-41e8-9eec-d0042c1bfca9 is already attached to instances: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2 May 10 21:23:58.251895 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:23:58.251895 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-92006e4d-72a6-494e-83ca-9e62189a37c7 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Returning 400 to user: Invalid volume: volume 535e59b4-e36b-41e8-9eec-d0042c1bfca9 is already attached to instances: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2 {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:23:58.251895 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-92006e4d-72a6-494e-83ca-9e62189a37c7 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "POST /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099550 May 10 21:23:58.251895 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 238/477] 10.222.0.25 () {60 vars in 1322 bytes} [Tue May 10 21:23:58 2022] POST /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 10 21:23:58.257152 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-1c976327-d3b2-40c8-a490-d01b21e262e9 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:58.257905 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-1c976327-d3b2-40c8-a490-d01b21e262e9 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 362a9924-7119-4e2e-bd41-d68a5f545009] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:58.264567 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1c976327-d3b2-40c8-a490-d01b21e262e9 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:58.265023 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1c976327-d3b2-40c8-a490-d01b21e262e9 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:58.265800 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1c976327-d3b2-40c8-a490-d01b21e262e9 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:58.266240 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1c976327-d3b2-40c8-a490-d01b21e262e9 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:58.274606 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-c346e500-21f6-4532-ba9c-6d9058928528 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:58.282564 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-c346e500-21f6-4532-ba9c-6d9058928528 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1736 microversion: 2.1 time: 0.155995 May 10 21:23:58.283556 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 240/478] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:58 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:23:58.299388 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-1c976327-d3b2-40c8-a490-d01b21e262e9 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 362a9924-7119-4e2e-bd41-d68a5f545009] Going to try to terminate instance {{(pid=117679) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 21:23:58.621145 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-1c976327-d3b2-40c8-a490-d01b21e262e9 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "DELETE /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009" status: 204 len: 0 microversion: 2.1 time: 0.368112 May 10 21:23:58.621754 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 239/479] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 10 21:23:58 2022] DELETE /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 21:23:58.630751 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-ceb66bd9-19d6-4e28-8dec-b3b9eecca82c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:58.631355 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-ceb66bd9-19d6-4e28-8dec-b3b9eecca82c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 362a9924-7119-4e2e-bd41-d68a5f545009] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:58.637496 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ceb66bd9-19d6-4e28-8dec-b3b9eecca82c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:58.637940 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ceb66bd9-19d6-4e28-8dec-b3b9eecca82c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:58.638735 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ceb66bd9-19d6-4e28-8dec-b3b9eecca82c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:58.639163 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ceb66bd9-19d6-4e28-8dec-b3b9eecca82c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:58.776394 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-ceb66bd9-19d6-4e28-8dec-b3b9eecca82c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:58.784331 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-ceb66bd9-19d6-4e28-8dec-b3b9eecca82c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009" status: 200 len: 1682 microversion: 2.1 time: 0.158314 May 10 21:23:58.794351 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 241/480] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:58 2022] GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:59.301275 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-983fc7e5-27a6-4379-921c-dba8e925c2c2 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:59.301983 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-983fc7e5-27a6-4379-921c-dba8e925c2c2 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:59.308314 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-983fc7e5-27a6-4379-921c-dba8e925c2c2 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:59.308762 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-983fc7e5-27a6-4379-921c-dba8e925c2c2 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:59.309534 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-983fc7e5-27a6-4379-921c-dba8e925c2c2 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:59.309969 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-983fc7e5-27a6-4379-921c-dba8e925c2c2 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:59.505126 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-983fc7e5-27a6-4379-921c-dba8e925c2c2 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:59.513148 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-983fc7e5-27a6-4379-921c-dba8e925c2c2 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1736 microversion: 2.1 time: 0.216091 May 10 21:23:59.513720 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 240/481] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:59 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:59.802216 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-bc7e8f8e-8361-42e8-8614-25b656934e0a tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:59.802850 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-bc7e8f8e-8361-42e8-8614-25b656934e0a tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 362a9924-7119-4e2e-bd41-d68a5f545009] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:59.809239 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-bc7e8f8e-8361-42e8-8614-25b656934e0a tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:59.809678 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-bc7e8f8e-8361-42e8-8614-25b656934e0a tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:59.810453 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-bc7e8f8e-8361-42e8-8614-25b656934e0a tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:59.810906 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-bc7e8f8e-8361-42e8-8614-25b656934e0a tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:59.942432 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-bc7e8f8e-8361-42e8-8614-25b656934e0a tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:59.950173 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-bc7e8f8e-8361-42e8-8614-25b656934e0a tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009" status: 200 len: 1682 microversion: 2.1 time: 0.152894 May 10 21:23:59.950780 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 242/482] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:23:59 2022] GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:00.434319 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-d0c32552-5c4c-4112-ad95-85ed64f1369c req-8425e1a7-5ef3-43f1-bb92-edcfa289620e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4f87d15-87fb-4ada-8b58-6fa220505241", "tag": "00f67420-6c95-4cc5-8544-bceeed674619"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:24:00.443800 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-d0c32552-5c4c-4112-ad95-85ed64f1369c req-8425e1a7-5ef3-43f1-bb92-edcfa289620e service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:00.444237 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-d0c32552-5c4c-4112-ad95-85ed64f1369c req-8425e1a7-5ef3-43f1-bb92-edcfa289620e service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:00.455920 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-d0c32552-5c4c-4112-ad95-85ed64f1369c req-8425e1a7-5ef3-43f1-bb92-edcfa289620e service nova] Creating event network-changed:00f67420-6c95-4cc5-8544-bceeed674619 for instance c4f87d15-87fb-4ada-8b58-6fa220505241 on hv-cinder-83608 May 10 21:24:00.461460 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-d0c32552-5c4c-4112-ad95-85ed64f1369c req-8425e1a7-5ef3-43f1-bb92-edcfa289620e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030934 May 10 21:24:00.462054 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 241/483] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:24:00.530974 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-6ea0ac72-e610-49a0-97b7-0aff549bfdd4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:00.532161 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-6ea0ac72-e610-49a0-97b7-0aff549bfdd4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:00.538583 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6ea0ac72-e610-49a0-97b7-0aff549bfdd4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:00.539156 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6ea0ac72-e610-49a0-97b7-0aff549bfdd4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:00.540051 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6ea0ac72-e610-49a0-97b7-0aff549bfdd4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:00.540573 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6ea0ac72-e610-49a0-97b7-0aff549bfdd4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:00.724395 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-6ea0ac72-e610-49a0-97b7-0aff549bfdd4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:00.734119 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-6ea0ac72-e610-49a0-97b7-0aff549bfdd4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1736 microversion: 2.1 time: 0.207013 May 10 21:24:00.743966 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 243/484] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:00 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1736 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:00.968206 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-81557993-0c93-4998-801e-385cd15df7cb tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:00.969161 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-81557993-0c93-4998-801e-385cd15df7cb tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 362a9924-7119-4e2e-bd41-d68a5f545009] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:00.976042 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-81557993-0c93-4998-801e-385cd15df7cb tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:00.976748 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-81557993-0c93-4998-801e-385cd15df7cb tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:00.977684 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-81557993-0c93-4998-801e-385cd15df7cb tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:00.978264 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-81557993-0c93-4998-801e-385cd15df7cb tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:01.368569 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-81557993-0c93-4998-801e-385cd15df7cb tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:01.378723 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-81557993-0c93-4998-801e-385cd15df7cb tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009" status: 200 len: 1682 microversion: 2.1 time: 0.414528 May 10 21:24:01.381422 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 242/485] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:00 2022] GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009 => generated 1682 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:01.751685 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-a741e158-aaa6-4bc0-b938-3219ab0ac9dd tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:01.752439 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-a741e158-aaa6-4bc0-b938-3219ab0ac9dd tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:01.760228 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-a741e158-aaa6-4bc0-b938-3219ab0ac9dd tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:01.760985 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-a741e158-aaa6-4bc0-b938-3219ab0ac9dd tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:01.761999 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-a741e158-aaa6-4bc0-b938-3219ab0ac9dd tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:01.762520 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-a741e158-aaa6-4bc0-b938-3219ab0ac9dd tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:01.932268 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-a741e158-aaa6-4bc0-b938-3219ab0ac9dd tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:01.940804 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-a741e158-aaa6-4bc0-b938-3219ab0ac9dd tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1736 microversion: 2.1 time: 0.192768 May 10 21:24:01.941029 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 244/486] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:01 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1736 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:02.400824 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-b5e62681-d448-49db-93b8-4b947fa95b94 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:02.402572 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-b5e62681-d448-49db-93b8-4b947fa95b94 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 362a9924-7119-4e2e-bd41-d68a5f545009] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:02.419436 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b5e62681-d448-49db-93b8-4b947fa95b94 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:02.421135 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b5e62681-d448-49db-93b8-4b947fa95b94 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:02.422074 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b5e62681-d448-49db-93b8-4b947fa95b94 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:02.422643 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b5e62681-d448-49db-93b8-4b947fa95b94 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:02.467771 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b5e62681-d448-49db-93b8-4b947fa95b94 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:02.468459 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b5e62681-d448-49db-93b8-4b947fa95b94 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:02.469145 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.objects.instance [None req-b5e62681-d448-49db-93b8-4b947fa95b94 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lazy-loading 'fault' on Instance uuid 362a9924-7119-4e2e-bd41-d68a5f545009 {{(pid=117679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:24:02.479025 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-b9073d0f-d702-4671-b0e7-4f65c66b5fa7 req-657db257-d77f-4156-82bd-f97fba7ff7a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "362a9924-7119-4e2e-bd41-d68a5f545009", "name": "network-vif-deleted", "tag": "d51acf48-316f-4040-b5d3-2beac72dba60"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:24:02.502828 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-b9073d0f-d702-4671-b0e7-4f65c66b5fa7 req-657db257-d77f-4156-82bd-f97fba7ff7a3 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:02.503283 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-b9073d0f-d702-4671-b0e7-4f65c66b5fa7 req-657db257-d77f-4156-82bd-f97fba7ff7a3 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:02.516423 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-b9073d0f-d702-4671-b0e7-4f65c66b5fa7 req-657db257-d77f-4156-82bd-f97fba7ff7a3 service nova] Creating event network-vif-deleted:d51acf48-316f-4040-b5d3-2beac72dba60 for instance 362a9924-7119-4e2e-bd41-d68a5f545009 on hv-cinder-83608 May 10 21:24:02.522659 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-b9073d0f-d702-4671-b0e7-4f65c66b5fa7 req-657db257-d77f-4156-82bd-f97fba7ff7a3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048306 May 10 21:24:02.523277 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 245/487] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:24:02.541257 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b5e62681-d448-49db-93b8-4b947fa95b94 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:02.548931 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-b5e62681-d448-49db-93b8-4b947fa95b94 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009" status: 200 len: 1331 microversion: 2.1 time: 0.153197 May 10 21:24:02.549722 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 243/488] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:02 2022] GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009 => generated 1331 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:02.961447 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-19285c7c-e7be-4b78-8c93-f6af67af9fea tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:02.961447 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-19285c7c-e7be-4b78-8c93-f6af67af9fea tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:02.966884 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-442dd874-27db-40bb-8ad2-d36bd3d3af76 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1295255861"}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:24:02.967425 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-442dd874-27db-40bb-8ad2-d36bd3d3af76 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:02.977385 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-442dd874-27db-40bb-8ad2-d36bd3d3af76 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:02.979676 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-19285c7c-e7be-4b78-8c93-f6af67af9fea tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:02.980365 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-442dd874-27db-40bb-8ad2-d36bd3d3af76 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:02.981330 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-442dd874-27db-40bb-8ad2-d36bd3d3af76 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:02.981913 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-442dd874-27db-40bb-8ad2-d36bd3d3af76 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:02.984187 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-19285c7c-e7be-4b78-8c93-f6af67af9fea tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:02.985197 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-19285c7c-e7be-4b78-8c93-f6af67af9fea tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:02.987589 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-19285c7c-e7be-4b78-8c93-f6af67af9fea tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:03.163756 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-19285c7c-e7be-4b78-8c93-f6af67af9fea tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:03.173805 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-19285c7c-e7be-4b78-8c93-f6af67af9fea tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1736 microversion: 2.1 time: 0.220349 May 10 21:24:03.177521 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.network.security_group_api [None req-442dd874-27db-40bb-8ad2-d36bd3d3af76 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Adding security group 118aa708-707e-48dc-9d81-57a3a4a5dcbd to port 00f67420-6c95-4cc5-8544-bceeed674619 May 10 21:24:03.179534 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 246/489] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:02 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1736 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:03.449489 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-7d4c9116-595b-47ce-a412-b64496dd0c89 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:03.449982 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-7d4c9116-595b-47ce-a412-b64496dd0c89 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:03.456014 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7d4c9116-595b-47ce-a412-b64496dd0c89 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:03.456450 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7d4c9116-595b-47ce-a412-b64496dd0c89 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:03.457300 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7d4c9116-595b-47ce-a412-b64496dd0c89 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:03.457735 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7d4c9116-595b-47ce-a412-b64496dd0c89 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:03.603686 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.objects.instance [None req-7d4c9116-595b-47ce-a412-b64496dd0c89 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lazy-loading 'services' on Instance uuid ef13be90-688a-4ebe-8b3c-c8187cf9cd70 {{(pid=117678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:24:03.659424 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-442dd874-27db-40bb-8ad2-d36bd3d3af76 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "POST /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241/action" status: 202 len: 0 microversion: 2.1 time: 0.696585 May 10 21:24:03.662165 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 244/490] 10.222.0.25 () {60 vars in 1277 bytes} [Tue May 10 21:24:02 2022] POST /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241/action => generated 0 bytes in 700 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 21:24:03.667494 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4c63ff8b-d709-42fc-b660-4fb250acaef2 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:03.668326 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-4c63ff8b-d709-42fc-b660-4fb250acaef2 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 362a9924-7119-4e2e-bd41-d68a5f545009] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:03.703563 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4c63ff8b-d709-42fc-b660-4fb250acaef2 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:03.704056 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4c63ff8b-d709-42fc-b660-4fb250acaef2 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:03.704967 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4c63ff8b-d709-42fc-b660-4fb250acaef2 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:03.705479 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4c63ff8b-d709-42fc-b660-4fb250acaef2 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:03.725784 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-4c63ff8b-d709-42fc-b660-4fb250acaef2 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] HTTP exception thrown: Instance 362a9924-7119-4e2e-bd41-d68a5f545009 could not be found. May 10 21:24:03.727580 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4c63ff8b-d709-42fc-b660-4fb250acaef2 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Request method failure captured: May 10 21:24:03.727580 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: request: GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009 HTTP/1.1 May 10 21:24:03.727580 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept: application/json May 10 21:24:03.727580 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity May 10 21:24:03.727580 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Connection: close May 10 21:24:03.727580 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Length: 0 May 10 21:24:03.727580 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Type: application/json May 10 21:24:03.727580 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Host: 10.222.0.25 May 10 21:24:03.727580 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None May 10 21:24:03.727580 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 May 10 21:24:03.727580 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABietccfViYRiOQpEa4ldvOHZyUgOQ2ZBBatS9SA20GCDt_AgmFvo4vE33WkYc6oqnMaRFSIYJbwKR_AxZ5OfoHdxsDJwPaySjCJQ5rrDhZmJbbtmsjCkN_RYEyYX6qvdoHvFk_bXj7SkSAx705IP0l1sxFz6bBTFTgIB8EAyrOf7pHKV8 May 10 21:24:03.727580 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Id: None May 10 21:24:03.727580 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Name: None May 10 21:24:03.727580 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed May 10 21:24:03.727580 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True May 10 21:24:03.727580 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default May 10 21:24:03.727580 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default May 10 21:24:03.727580 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Id: 8286226c580f4896aec72c65642fce30 May 10 21:24:03.727580 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-AttachVolumeNegativeTest-1863330069 May 10 21:24:03.727580 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Role: member,reader May 10 21:24:03.727580 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Roles: member,reader May 10 21:24:03.728875 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8286226c580f4896aec72c65642fce30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8286226c580f4896aec72c65642fce30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8286226c580f4896aec72c65642fce30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8286226c580f4896aec72c65642fce30"}]}] May 10 21:24:03.728875 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-AttachVolumeNegativeTest-1863330069 May 10 21:24:03.728875 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Id: 8286226c580f4896aec72c65642fce30 May 10 21:24:03.728875 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1863330069 May 10 21:24:03.728875 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User: tempest-AttachVolumeNegativeTest-1863330069-project May 10 21:24:03.728875 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default May 10 21:24:03.728875 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default May 10 21:24:03.728875 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Id: ca39678abe6e476283f94c675d4ea369 May 10 21:24:03.728875 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-AttachVolumeNegativeTest-1863330069-project May 10 21:24:03.728875 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: method: > May 10 21:24:03.728875 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: exception: Instance 362a9924-7119-4e2e-bd41-d68a5f545009 could not be found. May 10 21:24:03.728875 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: action_args: {'id': '362a9924-7119-4e2e-bd41-d68a5f545009'} May 10 21:24:03.729718 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:24:03.729718 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:24:03.729718 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:24:03.729718 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:24:03.729718 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:24:03.729718 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:24:03.729718 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:24:03.729718 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:24:03.729718 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:24:03.729718 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:24:03.729718 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 362a9924-7119-4e2e-bd41-d68a5f545009 could not be found. May 10 21:24:03.729718 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:24:03.729718 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:24:03.729718 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:24:03.729718 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:24:03.729718 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:24:03.729718 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:24:03.729718 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:24:03.729718 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:24:03.729718 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:24:03.730937 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:24:03.730937 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:24:03.730937 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:24:03.730937 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:24:03.730937 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:24:03.730937 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:24:03.730937 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:24:03.730937 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 362a9924-7119-4e2e-bd41-d68a5f545009 could not be found. May 10 21:24:03.730937 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:24:03.730937 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:24:03.730937 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:24:03.730937 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:24:03.730937 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:24:03.730937 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:24:03.730937 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:24:03.730937 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:24:03.730937 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 362a9924-7119-4e2e-bd41-d68a5f545009 could not be found. May 10 21:24:03.730937 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:24:03.733738 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4c63ff8b-d709-42fc-b660-4fb250acaef2 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Returning 404 to user: Instance 362a9924-7119-4e2e-bd41-d68a5f545009 could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:24:03.733738 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4c63ff8b-d709-42fc-b660-4fb250acaef2 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009" status: 404 len: 111 microversion: 2.1 time: 0.065673 May 10 21:24:03.733738 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 245/491] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:03 2022] GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:24:03.735056 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-cf864888-33be-468f-ad00-53315ff07075 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:03.735666 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-cf864888-33be-468f-ad00-53315ff07075 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:03.742347 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cf864888-33be-468f-ad00-53315ff07075 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:03.742824 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cf864888-33be-468f-ad00-53315ff07075 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:03.743608 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cf864888-33be-468f-ad00-53315ff07075 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:03.744043 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cf864888-33be-468f-ad00-53315ff07075 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:03.903273 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-7d4c9116-595b-47ce-a412-b64496dd0c89 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70/os-volume_attachments/f3b229f0-6da6-4ebe-b2da-a0d6a972f85c" status: 202 len: 0 microversion: 2.1 time: 0.457403 May 10 21:24:03.904087 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 247/492] 10.222.0.25 () {58 vars in 1415 bytes} [Tue May 10 21:24:03 2022] DELETE /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70/os-volume_attachments/f3b229f0-6da6-4ebe-b2da-a0d6a972f85c => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 21:24:03.927960 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-498827e7-791a-4de5-8852-9956b6630c5a tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '.version_select at 0x7f7aea4fe820>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:04.039828 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-cf864888-33be-468f-ad00-53315ff07075 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:04.059601 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-cf864888-33be-468f-ad00-53315ff07075 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1759 microversion: 2.1 time: 0.328259 May 10 21:24:04.061858 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 246/493] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:03 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1759 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:04.080570 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-498827e7-791a-4de5-8852-9956b6630c5a tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1009693388" status: 202 len: 0 microversion: 2.1 time: 0.158183 May 10 21:24:04.093965 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 248/494] 10.222.0.25 () {58 vars in 1220 bytes} [Tue May 10 21:24:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1009693388 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 21:24:04.197163 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-b7803779-4f21-4ce2-a9e9-45d2573dc3d5 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:04.197948 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-b7803779-4f21-4ce2-a9e9-45d2573dc3d5 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:04.204667 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b7803779-4f21-4ce2-a9e9-45d2573dc3d5 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:04.205336 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b7803779-4f21-4ce2-a9e9-45d2573dc3d5 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:04.206313 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b7803779-4f21-4ce2-a9e9-45d2573dc3d5 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:04.206770 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b7803779-4f21-4ce2-a9e9-45d2573dc3d5 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:04.534221 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b7803779-4f21-4ce2-a9e9-45d2573dc3d5 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:04.546349 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-b7803779-4f21-4ce2-a9e9-45d2573dc3d5 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1736 microversion: 2.1 time: 0.353625 May 10 21:24:04.557262 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 247/495] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:04 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1736 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:04.578814 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-8504de9b-4768-4e46-b399-05be6ee5f60e req-02783645-4df4-41b2-b023-f117ab5cc6ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4f87d15-87fb-4ada-8b58-6fa220505241", "tag": "00f67420-6c95-4cc5-8544-bceeed674619"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:24:04.598963 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-8504de9b-4768-4e46-b399-05be6ee5f60e req-02783645-4df4-41b2-b023-f117ab5cc6ff service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:04.599481 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-8504de9b-4768-4e46-b399-05be6ee5f60e req-02783645-4df4-41b2-b023-f117ab5cc6ff service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:04.614050 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-8504de9b-4768-4e46-b399-05be6ee5f60e req-02783645-4df4-41b2-b023-f117ab5cc6ff service nova] Creating event network-changed:00f67420-6c95-4cc5-8544-bceeed674619 for instance c4f87d15-87fb-4ada-8b58-6fa220505241 on hv-cinder-83608 May 10 21:24:04.620837 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-8504de9b-4768-4e46-b399-05be6ee5f60e req-02783645-4df4-41b2-b023-f117ab5cc6ff service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044967 May 10 21:24:04.621966 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 249/496] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:24:05.085874 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e95c503c-0f1b-4c9c-bb9d-2230ea997623 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:24:05.092075 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e95c503c-0f1b-4c9c-bb9d-2230ea997623 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:05.092519 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e95c503c-0f1b-4c9c-bb9d-2230ea997623 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:05.116557 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-e95c503c-0f1b-4c9c-bb9d-2230ea997623 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Going to try to stop instance {{(pid=117679) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 10 21:24:05.303447 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-e95c503c-0f1b-4c9c-bb9d-2230ea997623 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "POST /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70/action" status: 202 len: 0 microversion: 2.1 time: 0.221991 May 10 21:24:05.308167 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 248/497] 10.222.0.25 () {60 vars in 1277 bytes} [Tue May 10 21:24:05 2022] POST /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 21:24:05.313400 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-64a9c346-7992-4a0a-8069-113fb70dbccb tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:05.314098 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-64a9c346-7992-4a0a-8069-113fb70dbccb tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:05.322175 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-64a9c346-7992-4a0a-8069-113fb70dbccb tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:05.322528 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-64a9c346-7992-4a0a-8069-113fb70dbccb tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:05.323351 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-64a9c346-7992-4a0a-8069-113fb70dbccb tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:05.323790 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-64a9c346-7992-4a0a-8069-113fb70dbccb tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:05.479732 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-64a9c346-7992-4a0a-8069-113fb70dbccb tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:05.488009 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-64a9c346-7992-4a0a-8069-113fb70dbccb tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1674 microversion: 2.1 time: 0.179291 May 10 21:24:05.498870 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 250/498] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:05 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1674 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:05.564521 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-f5f94e9f-2fcf-46a4-ae53-eeefef75bdec tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:05.565223 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-f5f94e9f-2fcf-46a4-ae53-eeefef75bdec tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:05.572542 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f5f94e9f-2fcf-46a4-ae53-eeefef75bdec tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:05.572998 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f5f94e9f-2fcf-46a4-ae53-eeefef75bdec tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:05.573849 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f5f94e9f-2fcf-46a4-ae53-eeefef75bdec tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:05.574294 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f5f94e9f-2fcf-46a4-ae53-eeefef75bdec tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:05.601775 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-94c669e7-98dc-46e9-8751-8bb46103594c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:05.602416 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-94c669e7-98dc-46e9-8751-8bb46103594c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:05.608319 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-94c669e7-98dc-46e9-8751-8bb46103594c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:05.608862 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-94c669e7-98dc-46e9-8751-8bb46103594c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:05.609713 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-94c669e7-98dc-46e9-8751-8bb46103594c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:05.610239 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-94c669e7-98dc-46e9-8751-8bb46103594c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:05.689548 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.objects.instance [None req-94c669e7-98dc-46e9-8751-8bb46103594c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lazy-loading 'services' on Instance uuid 9c94150b-0bc5-4635-b761-9f16d6f0b0a2 {{(pid=117678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:24:05.746767 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-f5f94e9f-2fcf-46a4-ae53-eeefef75bdec tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:05.755035 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-f5f94e9f-2fcf-46a4-ae53-eeefef75bdec tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1736 microversion: 2.1 time: 0.194996 May 10 21:24:05.763892 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 249/499] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:05 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1736 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:05.986148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-94c669e7-98dc-46e9-8751-8bb46103594c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2/os-volume_attachments/535e59b4-e36b-41e8-9eec-d0042c1bfca9" status: 202 len: 0 microversion: 2.1 time: 0.388383 May 10 21:24:05.986878 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 251/500] 10.222.0.25 () {58 vars in 1415 bytes} [Tue May 10 21:24:05 2022] DELETE /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2/os-volume_attachments/535e59b4-e36b-41e8-9eec-d0042c1bfca9 => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 21:24:05.996794 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-90f1f0c0-b142-4b49-9234-3f91b4fa1229 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:05.997771 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-90f1f0c0-b142-4b49-9234-3f91b4fa1229 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:06.004804 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-90f1f0c0-b142-4b49-9234-3f91b4fa1229 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:06.005228 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-90f1f0c0-b142-4b49-9234-3f91b4fa1229 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:06.006010 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-90f1f0c0-b142-4b49-9234-3f91b4fa1229 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:06.006432 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-90f1f0c0-b142-4b49-9234-3f91b4fa1229 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:06.037498 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-90f1f0c0-b142-4b49-9234-3f91b4fa1229 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045524 May 10 21:24:06.053315 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 250/501] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 10 21:24:05 2022] GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:24:06.507706 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-5dc33bbc-af54-4ecc-bec5-2e672750cf45 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:06.508663 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-5dc33bbc-af54-4ecc-bec5-2e672750cf45 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:06.514990 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5dc33bbc-af54-4ecc-bec5-2e672750cf45 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:06.515437 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5dc33bbc-af54-4ecc-bec5-2e672750cf45 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:06.516199 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5dc33bbc-af54-4ecc-bec5-2e672750cf45 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:06.516632 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5dc33bbc-af54-4ecc-bec5-2e672750cf45 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:06.643672 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-5dc33bbc-af54-4ecc-bec5-2e672750cf45 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:06.651513 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-5dc33bbc-af54-4ecc-bec5-2e672750cf45 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1674 microversion: 2.1 time: 0.149281 May 10 21:24:06.652079 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 252/502] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:06 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:06.779433 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-3880e480-1ff0-4cde-aad5-e3717756c87d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:06.780059 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-3880e480-1ff0-4cde-aad5-e3717756c87d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:06.787158 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3880e480-1ff0-4cde-aad5-e3717756c87d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:06.788379 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3880e480-1ff0-4cde-aad5-e3717756c87d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:06.788616 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3880e480-1ff0-4cde-aad5-e3717756c87d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:06.789059 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3880e480-1ff0-4cde-aad5-e3717756c87d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:06.922615 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-3880e480-1ff0-4cde-aad5-e3717756c87d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:06.931133 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-3880e480-1ff0-4cde-aad5-e3717756c87d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1736 microversion: 2.1 time: 0.155532 May 10 21:24:06.931701 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 251/503] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:06 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:07.063619 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-312ca972-3662-4937-adf1-709bb1abb668 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:07.064584 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-312ca972-3662-4937-adf1-709bb1abb668 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:07.071099 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-312ca972-3662-4937-adf1-709bb1abb668 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:07.071544 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-312ca972-3662-4937-adf1-709bb1abb668 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:07.072309 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-312ca972-3662-4937-adf1-709bb1abb668 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:07.072736 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-312ca972-3662-4937-adf1-709bb1abb668 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:07.106578 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-312ca972-3662-4937-adf1-709bb1abb668 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047237 May 10 21:24:07.107129 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 253/504] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 10 21:24:07 2022] GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:24:07.669299 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-5935e062-2ea3-45c2-b776-cd8ec31e5fd5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:07.669902 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-5935e062-2ea3-45c2-b776-cd8ec31e5fd5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:07.675830 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5935e062-2ea3-45c2-b776-cd8ec31e5fd5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:07.676279 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5935e062-2ea3-45c2-b776-cd8ec31e5fd5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:07.677069 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5935e062-2ea3-45c2-b776-cd8ec31e5fd5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:07.677540 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5935e062-2ea3-45c2-b776-cd8ec31e5fd5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:07.807172 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-5935e062-2ea3-45c2-b776-cd8ec31e5fd5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:07.814379 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-5935e062-2ea3-45c2-b776-cd8ec31e5fd5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1674 microversion: 2.1 time: 0.149211 May 10 21:24:07.814970 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 252/505] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:07 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:07.948290 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-71598f0a-211a-4f90-aafd-c6695d03a72a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:07.948811 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-71598f0a-211a-4f90-aafd-c6695d03a72a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:07.955132 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-71598f0a-211a-4f90-aafd-c6695d03a72a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:07.955572 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-71598f0a-211a-4f90-aafd-c6695d03a72a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:07.956325 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-71598f0a-211a-4f90-aafd-c6695d03a72a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:07.956806 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-71598f0a-211a-4f90-aafd-c6695d03a72a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:08.081402 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-71598f0a-211a-4f90-aafd-c6695d03a72a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:08.089822 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-71598f0a-211a-4f90-aafd-c6695d03a72a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1736 microversion: 2.1 time: 0.145399 May 10 21:24:08.090478 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 254/506] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:07 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:08.118340 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-d1f53ecf-77bf-4da8-bb7b-1332c3c8f696 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:08.119372 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-d1f53ecf-77bf-4da8-bb7b-1332c3c8f696 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:08.125250 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d1f53ecf-77bf-4da8-bb7b-1332c3c8f696 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:08.132582 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d1f53ecf-77bf-4da8-bb7b-1332c3c8f696 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:08.132582 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d1f53ecf-77bf-4da8-bb7b-1332c3c8f696 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:08.132582 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d1f53ecf-77bf-4da8-bb7b-1332c3c8f696 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:08.156349 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-d1f53ecf-77bf-4da8-bb7b-1332c3c8f696 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041922 May 10 21:24:08.161144 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 253/507] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 10 21:24:08 2022] GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 21:24:08.213182 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-6b3fb19a-537e-4c4a-b2ca-31ec11050b4b tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:08.213610 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-6b3fb19a-537e-4c4a-b2ca-31ec11050b4b tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:08.219534 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6b3fb19a-537e-4c4a-b2ca-31ec11050b4b tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:08.219980 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6b3fb19a-537e-4c4a-b2ca-31ec11050b4b tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:08.220737 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6b3fb19a-537e-4c4a-b2ca-31ec11050b4b tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:08.221164 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6b3fb19a-537e-4c4a-b2ca-31ec11050b4b tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:08.245769 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-6b3fb19a-537e-4c4a-b2ca-31ec11050b4b tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2] Going to try to terminate instance {{(pid=117678) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 21:24:08.536661 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-6b3fb19a-537e-4c4a-b2ca-31ec11050b4b tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2" status: 204 len: 0 microversion: 2.1 time: 0.326923 May 10 21:24:08.537269 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 255/508] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 10 21:24:08 2022] DELETE /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 21:24:08.545210 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-70567d51-0431-4cb1-b78f-f9db0ab8e2da tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:08.545821 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-70567d51-0431-4cb1-b78f-f9db0ab8e2da tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:08.553904 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-70567d51-0431-4cb1-b78f-f9db0ab8e2da tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:08.557857 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-70567d51-0431-4cb1-b78f-f9db0ab8e2da tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:08.557857 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-70567d51-0431-4cb1-b78f-f9db0ab8e2da tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:08.557857 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-70567d51-0431-4cb1-b78f-f9db0ab8e2da tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:08.684062 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-70567d51-0431-4cb1-b78f-f9db0ab8e2da tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:08.691418 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-70567d51-0431-4cb1-b78f-f9db0ab8e2da tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2" status: 200 len: 1681 microversion: 2.1 time: 0.149971 May 10 21:24:08.692248 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 254/509] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:08 2022] GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:08.832462 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-62f11713-1ced-4280-8df7-215654a8faac tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:08.833177 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-62f11713-1ced-4280-8df7-215654a8faac tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:08.839146 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-62f11713-1ced-4280-8df7-215654a8faac tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:08.839583 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-62f11713-1ced-4280-8df7-215654a8faac tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:08.840340 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-62f11713-1ced-4280-8df7-215654a8faac tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:08.840764 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-62f11713-1ced-4280-8df7-215654a8faac tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:09.114835 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-38d47863-df89-4001-a614-dedc7b93c754 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:09.115449 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-38d47863-df89-4001-a614-dedc7b93c754 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:09.121907 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-38d47863-df89-4001-a614-dedc7b93c754 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:09.122355 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-38d47863-df89-4001-a614-dedc7b93c754 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:09.123162 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-38d47863-df89-4001-a614-dedc7b93c754 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:09.123593 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-38d47863-df89-4001-a614-dedc7b93c754 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:09.197260 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-62f11713-1ced-4280-8df7-215654a8faac tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:09.204949 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-62f11713-1ced-4280-8df7-215654a8faac tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1674 microversion: 2.1 time: 0.376743 May 10 21:24:09.205529 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 256/510] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:08 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1674 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:09.257090 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-38d47863-df89-4001-a614-dedc7b93c754 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:09.265227 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-38d47863-df89-4001-a614-dedc7b93c754 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1736 microversion: 2.1 time: 0.154541 May 10 21:24:09.265804 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 255/511] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:09 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:24:09.708969 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-ebb1ef9f-e4e1-477a-9dcf-5705d24884c8 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:09.709578 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-ebb1ef9f-e4e1-477a-9dcf-5705d24884c8 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:09.715588 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ebb1ef9f-e4e1-477a-9dcf-5705d24884c8 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:09.716036 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ebb1ef9f-e4e1-477a-9dcf-5705d24884c8 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:09.716801 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ebb1ef9f-e4e1-477a-9dcf-5705d24884c8 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:09.717238 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ebb1ef9f-e4e1-477a-9dcf-5705d24884c8 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:09.849231 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-ebb1ef9f-e4e1-477a-9dcf-5705d24884c8 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:09.857865 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-ebb1ef9f-e4e1-477a-9dcf-5705d24884c8 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2" status: 200 len: 1681 microversion: 2.1 time: 0.152874 May 10 21:24:09.858486 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 257/512] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:09 2022] GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:10.223263 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-b69afef6-d63d-40fe-a583-b4ef577e2975 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:10.223909 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-b69afef6-d63d-40fe-a583-b4ef577e2975 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:10.230248 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b69afef6-d63d-40fe-a583-b4ef577e2975 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:10.230721 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b69afef6-d63d-40fe-a583-b4ef577e2975 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:10.231474 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b69afef6-d63d-40fe-a583-b4ef577e2975 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:10.231897 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b69afef6-d63d-40fe-a583-b4ef577e2975 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:10.282636 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-5600d04c-6159-4fdc-85a1-2da0d4e2107e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:10.283352 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-5600d04c-6159-4fdc-85a1-2da0d4e2107e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:10.290459 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5600d04c-6159-4fdc-85a1-2da0d4e2107e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:10.290900 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5600d04c-6159-4fdc-85a1-2da0d4e2107e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:10.291692 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5600d04c-6159-4fdc-85a1-2da0d4e2107e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:10.292117 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5600d04c-6159-4fdc-85a1-2da0d4e2107e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:10.360869 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b69afef6-d63d-40fe-a583-b4ef577e2975 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:10.369156 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-b69afef6-d63d-40fe-a583-b4ef577e2975 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1674 microversion: 2.1 time: 0.150288 May 10 21:24:10.369923 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 256/513] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:10 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:10.425227 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-5600d04c-6159-4fdc-85a1-2da0d4e2107e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:10.433573 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-5600d04c-6159-4fdc-85a1-2da0d4e2107e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1736 microversion: 2.1 time: 0.154710 May 10 21:24:10.434157 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 258/514] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:10 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:24:10.878168 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-de0ab7d2-2ecc-4b8e-92a1-8e424ff5d001 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:10.878804 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-de0ab7d2-2ecc-4b8e-92a1-8e424ff5d001 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:10.885754 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-de0ab7d2-2ecc-4b8e-92a1-8e424ff5d001 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:10.886199 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-de0ab7d2-2ecc-4b8e-92a1-8e424ff5d001 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:10.887008 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-de0ab7d2-2ecc-4b8e-92a1-8e424ff5d001 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:10.887436 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-de0ab7d2-2ecc-4b8e-92a1-8e424ff5d001 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:11.042675 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-de0ab7d2-2ecc-4b8e-92a1-8e424ff5d001 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:11.049827 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-de0ab7d2-2ecc-4b8e-92a1-8e424ff5d001 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2" status: 200 len: 1681 microversion: 2.1 time: 0.175483 May 10 21:24:11.050398 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 257/515] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:10 2022] GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2 => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:11.386274 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-b34e245c-447e-4789-b776-7e43cafd93a9 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:11.386927 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-b34e245c-447e-4789-b776-7e43cafd93a9 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:11.393205 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b34e245c-447e-4789-b776-7e43cafd93a9 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:11.393643 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b34e245c-447e-4789-b776-7e43cafd93a9 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:11.394419 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b34e245c-447e-4789-b776-7e43cafd93a9 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:11.394902 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b34e245c-447e-4789-b776-7e43cafd93a9 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:11.450985 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-b750cd33-ae15-4595-b2b1-cb682af1513d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:11.451593 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-b750cd33-ae15-4595-b2b1-cb682af1513d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:11.458101 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b750cd33-ae15-4595-b2b1-cb682af1513d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:11.458577 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b750cd33-ae15-4595-b2b1-cb682af1513d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:11.459338 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b750cd33-ae15-4595-b2b1-cb682af1513d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:11.459769 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b750cd33-ae15-4595-b2b1-cb682af1513d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:11.522837 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-b34e245c-447e-4789-b776-7e43cafd93a9 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:11.530072 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-b34e245c-447e-4789-b776-7e43cafd93a9 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1674 microversion: 2.1 time: 0.147861 May 10 21:24:11.530908 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 259/516] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:11 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:11.588792 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b750cd33-ae15-4595-b2b1-cb682af1513d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:11.596758 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-b750cd33-ae15-4595-b2b1-cb682af1513d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1736 microversion: 2.1 time: 0.149591 May 10 21:24:11.597346 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 258/517] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:11 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:24:12.068358 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-047a89b6-d5ae-443b-96c6-42aeb9dacb9d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:12.068961 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-047a89b6-d5ae-443b-96c6-42aeb9dacb9d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:12.074978 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-047a89b6-d5ae-443b-96c6-42aeb9dacb9d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:12.075426 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-047a89b6-d5ae-443b-96c6-42aeb9dacb9d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:12.076192 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-047a89b6-d5ae-443b-96c6-42aeb9dacb9d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:12.076622 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-047a89b6-d5ae-443b-96c6-42aeb9dacb9d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:12.224954 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-047a89b6-d5ae-443b-96c6-42aeb9dacb9d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:12.232360 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-047a89b6-d5ae-443b-96c6-42aeb9dacb9d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2" status: 200 len: 1681 microversion: 2.1 time: 0.168842 May 10 21:24:12.232951 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 260/518] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:12 2022] GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:12.547717 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-1b40f879-0b4f-46a0-950c-a1a7884421fb tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:12.548445 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-1b40f879-0b4f-46a0-950c-a1a7884421fb tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:12.555468 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1b40f879-0b4f-46a0-950c-a1a7884421fb tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:12.555912 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1b40f879-0b4f-46a0-950c-a1a7884421fb tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:12.556681 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1b40f879-0b4f-46a0-950c-a1a7884421fb tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:12.557125 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1b40f879-0b4f-46a0-950c-a1a7884421fb tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:12.615238 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-161e66bc-78eb-4cee-b627-5af2f0b26b0c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:12.615860 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-161e66bc-78eb-4cee-b627-5af2f0b26b0c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:12.622135 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-161e66bc-78eb-4cee-b627-5af2f0b26b0c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:12.622619 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-161e66bc-78eb-4cee-b627-5af2f0b26b0c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:12.623389 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-161e66bc-78eb-4cee-b627-5af2f0b26b0c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:12.623823 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-161e66bc-78eb-4cee-b627-5af2f0b26b0c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:12.705612 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1b40f879-0b4f-46a0-950c-a1a7884421fb tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:12.713547 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-1b40f879-0b4f-46a0-950c-a1a7884421fb tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1674 microversion: 2.1 time: 0.169703 May 10 21:24:12.714133 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 259/519] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:12 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1674 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:12.754072 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-161e66bc-78eb-4cee-b627-5af2f0b26b0c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:12.763169 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-161e66bc-78eb-4cee-b627-5af2f0b26b0c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1736 microversion: 2.1 time: 0.152567 May 10 21:24:12.763758 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 261/520] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:12 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:24:13.059042 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-ca0d62fa-c181-4761-bf7e-eab9c23c7cbf req-98cccd6b-367c-4674-b951-ea10ba4fe66a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c94150b-0bc5-4635-b761-9f16d6f0b0a2", "name": "network-vif-deleted", "tag": "7866c29a-c7c3-4ff7-b763-4708fc1851a8"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:24:13.067842 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-ca0d62fa-c181-4761-bf7e-eab9c23c7cbf req-98cccd6b-367c-4674-b951-ea10ba4fe66a service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:13.068352 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-ca0d62fa-c181-4761-bf7e-eab9c23c7cbf req-98cccd6b-367c-4674-b951-ea10ba4fe66a service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:13.079514 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-ca0d62fa-c181-4761-bf7e-eab9c23c7cbf req-98cccd6b-367c-4674-b951-ea10ba4fe66a service nova] Creating event network-vif-deleted:7866c29a-c7c3-4ff7-b763-4708fc1851a8 for instance 9c94150b-0bc5-4635-b761-9f16d6f0b0a2 on hv-cinder-83608 May 10 21:24:13.085310 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-ca0d62fa-c181-4761-bf7e-eab9c23c7cbf req-98cccd6b-367c-4674-b951-ea10ba4fe66a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029865 May 10 21:24:13.086013 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 260/521] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:24:13.249984 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-2e07b4fd-0614-4dfb-ae05-1d7bf43a450c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:13.250896 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-2e07b4fd-0614-4dfb-ae05-1d7bf43a450c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:13.261974 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2e07b4fd-0614-4dfb-ae05-1d7bf43a450c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:13.262775 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2e07b4fd-0614-4dfb-ae05-1d7bf43a450c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:13.264305 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2e07b4fd-0614-4dfb-ae05-1d7bf43a450c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:13.264935 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2e07b4fd-0614-4dfb-ae05-1d7bf43a450c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:13.339322 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-2e07b4fd-0614-4dfb-ae05-1d7bf43a450c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:13.348352 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-2e07b4fd-0614-4dfb-ae05-1d7bf43a450c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2" status: 200 len: 1614 microversion: 2.1 time: 0.102174 May 10 21:24:13.348947 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 262/522] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:13 2022] GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2 => generated 1614 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:13.731960 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-416b1217-3b95-4762-8f3a-75dfe0238f09 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:13.732677 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-416b1217-3b95-4762-8f3a-75dfe0238f09 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:13.739433 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-416b1217-3b95-4762-8f3a-75dfe0238f09 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:13.739873 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-416b1217-3b95-4762-8f3a-75dfe0238f09 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:13.740641 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-416b1217-3b95-4762-8f3a-75dfe0238f09 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:13.741077 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-416b1217-3b95-4762-8f3a-75dfe0238f09 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:13.780998 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-f9771c2f-2e21-4812-975a-a5c9f280188d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:13.781687 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-f9771c2f-2e21-4812-975a-a5c9f280188d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:13.790187 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f9771c2f-2e21-4812-975a-a5c9f280188d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:13.790752 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f9771c2f-2e21-4812-975a-a5c9f280188d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:13.792635 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f9771c2f-2e21-4812-975a-a5c9f280188d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:13.792635 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f9771c2f-2e21-4812-975a-a5c9f280188d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:13.889846 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-416b1217-3b95-4762-8f3a-75dfe0238f09 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:13.898585 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-416b1217-3b95-4762-8f3a-75dfe0238f09 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1674 microversion: 2.1 time: 0.170687 May 10 21:24:13.899769 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 261/523] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:13 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1674 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:13.942471 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-f9771c2f-2e21-4812-975a-a5c9f280188d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:13.950569 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-f9771c2f-2e21-4812-975a-a5c9f280188d tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1716 microversion: 2.1 time: 0.173788 May 10 21:24:13.951171 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 263/524] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:13 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1716 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:24:14.057047 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a6218462-14cc-4127-8ee5-7c8b5a1e5d16 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:14.057545 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-a6218462-14cc-4127-8ee5-7c8b5a1e5d16 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:14.063630 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a6218462-14cc-4127-8ee5-7c8b5a1e5d16 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:14.064079 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a6218462-14cc-4127-8ee5-7c8b5a1e5d16 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:14.064848 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a6218462-14cc-4127-8ee5-7c8b5a1e5d16 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:14.065286 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a6218462-14cc-4127-8ee5-7c8b5a1e5d16 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:14.190719 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-a6218462-14cc-4127-8ee5-7c8b5a1e5d16 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] HTTP exception thrown: Cannot 'detach_volume' instance e6abd4e9-f5fd-4413-9d26-808c47d618ab while it is in vm_state rescued May 10 21:24:14.193096 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a6218462-14cc-4127-8ee5-7c8b5a1e5d16 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Request method failure captured: May 10 21:24:14.193096 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: request: DELETE /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab/os-volume_attachments/505c516f-42bc-4978-a113-aee2198b7892 HTTP/1.1 May 10 21:24:14.193096 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept: application/json May 10 21:24:14.193096 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity May 10 21:24:14.193096 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Connection: close May 10 21:24:14.193096 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Length: 0 May 10 21:24:14.193096 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Type: application/json May 10 21:24:14.193096 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Host: 10.222.0.25 May 10 21:24:14.193096 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None May 10 21:24:14.193096 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 May 10 21:24:14.193096 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABietceoa2YDFp3vDe6jovGDog94X8BICE9yqvDWgY5jdGYdkHB2lHnE5qpy-JGn-DuIb7JDkx8klyX_PhGtRnUB4IyuUehUiSCq89-lTpBX74SCgCRj4KBQmjjs3BGumQQ03DMZXdd0ZUBAC18LfTUVRuOE-vNOyfC2OTzFN94f1GAdHA May 10 21:24:14.193096 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Id: None May 10 21:24:14.193096 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Name: None May 10 21:24:14.193096 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed May 10 21:24:14.193096 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True May 10 21:24:14.193096 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default May 10 21:24:14.193096 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default May 10 21:24:14.193096 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Id: 78072ca90bf6402b83863597c266a178 May 10 21:24:14.193096 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-845733436 May 10 21:24:14.193096 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Role: member,reader May 10 21:24:14.193096 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Roles: member,reader May 10 21:24:14.194680 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78072ca90bf6402b83863597c266a178"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_78072ca90bf6402b83863597c266a178"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78072ca90bf6402b83863597c266a178"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/78072ca90bf6402b83863597c266a178"}]}] May 10 21:24:14.194680 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-ServerRescueNegativeTestJSON-845733436 May 10 21:24:14.194680 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Id: 78072ca90bf6402b83863597c266a178 May 10 21:24:14.194680 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-845733436 May 10 21:24:14.194680 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User: tempest-ServerRescueNegativeTestJSON-845733436-project May 10 21:24:14.194680 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default May 10 21:24:14.194680 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default May 10 21:24:14.194680 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Id: 02af0eded57547f489be63cd6dc09399 May 10 21:24:14.194680 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-ServerRescueNegativeTestJSON-845733436-project May 10 21:24:14.194680 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: method: > May 10 21:24:14.194680 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: exception: Cannot 'detach_volume' instance e6abd4e9-f5fd-4413-9d26-808c47d618ab while it is in vm_state rescued May 10 21:24:14.195470 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: action_args: {'server_id': 'e6abd4e9-f5fd-4413-9d26-808c47d618ab', 'id': '505c516f-42bc-4978-a113-aee2198b7892'} May 10 21:24:14.195470 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:24:14.195470 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:24:14.195470 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 10 21:24:14.195470 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 10 21:24:14.195470 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 21:24:14.195470 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 21:24:14.195470 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 10 21:24:14.195470 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 10 21:24:14.195470 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e6abd4e9-f5fd-4413-9d26-808c47d618ab in vm_state rescued. Cannot detach_volume while the instance is in this state. May 10 21:24:14.195470 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:24:14.195470 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:24:14.195470 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:24:14.195470 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:24:14.195470 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:24:14.195470 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:24:14.195470 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:24:14.195470 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:24:14.195470 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:24:14.195470 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:24:14.196819 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 10 21:24:14.196819 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 10 21:24:14.196819 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 10 21:24:14.196819 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 21:24:14.196819 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e6abd4e9-f5fd-4413-9d26-808c47d618ab while it is in vm_state rescued May 10 21:24:14.196819 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:24:14.196819 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:24:14.196819 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:24:14.196819 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:24:14.196819 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:24:14.196819 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:24:14.196819 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:24:14.196819 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:24:14.196819 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e6abd4e9-f5fd-4413-9d26-808c47d618ab while it is in vm_state rescued May 10 21:24:14.196819 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:24:14.196819 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a6218462-14cc-4127-8ee5-7c8b5a1e5d16 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Returning 409 to user: Cannot 'detach_volume' instance e6abd4e9-f5fd-4413-9d26-808c47d618ab while it is in vm_state rescued {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:24:14.197811 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-a6218462-14cc-4127-8ee5-7c8b5a1e5d16 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab/os-volume_attachments/505c516f-42bc-4978-a113-aee2198b7892" status: 409 len: 152 microversion: 2.1 time: 0.141453 May 10 21:24:14.197811 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 262/525] 10.222.0.25 () {58 vars in 1415 bytes} [Tue May 10 21:24:14 2022] DELETE /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab/os-volume_attachments/505c516f-42bc-4978-a113-aee2198b7892 => generated 152 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 10 21:24:14.203714 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-e1c9e941-2407-476d-a397-7c903b909236 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:24:14.204241 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-e1c9e941-2407-476d-a397-7c903b909236 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:14.210969 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e1c9e941-2407-476d-a397-7c903b909236 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:14.211414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e1c9e941-2407-476d-a397-7c903b909236 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:14.212208 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e1c9e941-2407-476d-a397-7c903b909236 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:14.212645 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e1c9e941-2407-476d-a397-7c903b909236 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:14.365090 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-116c0dff-357b-49b2-a71f-ed898717d2c0 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:14.365692 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-116c0dff-357b-49b2-a71f-ed898717d2c0 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:14.372334 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-116c0dff-357b-49b2-a71f-ed898717d2c0 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:14.372778 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-116c0dff-357b-49b2-a71f-ed898717d2c0 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:14.373540 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-116c0dff-357b-49b2-a71f-ed898717d2c0 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:14.373976 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-116c0dff-357b-49b2-a71f-ed898717d2c0 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:14.392361 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-e1c9e941-2407-476d-a397-7c903b909236 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "POST /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab/action" status: 202 len: 0 microversion: 2.1 time: 0.192388 May 10 21:24:14.393098 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 264/526] 10.222.0.25 () {60 vars in 1277 bytes} [Tue May 10 21:24:14 2022] POST /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 21:24:14.403322 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-b55a010d-51a8-4414-b6a9-182e2548183c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:14.404291 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-b55a010d-51a8-4414-b6a9-182e2548183c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:14.411925 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b55a010d-51a8-4414-b6a9-182e2548183c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:14.412709 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b55a010d-51a8-4414-b6a9-182e2548183c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:14.413732 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b55a010d-51a8-4414-b6a9-182e2548183c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:14.414465 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b55a010d-51a8-4414-b6a9-182e2548183c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:14.418734 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-116c0dff-357b-49b2-a71f-ed898717d2c0 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:14.419188 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-116c0dff-357b-49b2-a71f-ed898717d2c0 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:14.419673 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.objects.instance [None req-116c0dff-357b-49b2-a71f-ed898717d2c0 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lazy-loading 'fault' on Instance uuid 9c94150b-0bc5-4635-b761-9f16d6f0b0a2 {{(pid=117679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:24:14.474188 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-116c0dff-357b-49b2-a71f-ed898717d2c0 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:14.482718 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-116c0dff-357b-49b2-a71f-ed898717d2c0 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2" status: 200 len: 1331 microversion: 2.1 time: 0.121354 May 10 21:24:14.483590 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 263/527] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:14 2022] GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2 => generated 1331 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:24:14.559324 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-b55a010d-51a8-4414-b6a9-182e2548183c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:14.567723 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-b55a010d-51a8-4414-b6a9-182e2548183c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1724 microversion: 2.1 time: 0.168580 May 10 21:24:14.568867 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 265/528] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:14 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:14.916924 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-999ce685-40ab-452b-8e64-0bf5beb82a4a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:14.917534 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-999ce685-40ab-452b-8e64-0bf5beb82a4a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:14.923600 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-999ce685-40ab-452b-8e64-0bf5beb82a4a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:14.924043 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-999ce685-40ab-452b-8e64-0bf5beb82a4a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:14.924808 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-999ce685-40ab-452b-8e64-0bf5beb82a4a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:14.925274 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-999ce685-40ab-452b-8e64-0bf5beb82a4a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:15.455224 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-999ce685-40ab-452b-8e64-0bf5beb82a4a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:15.463458 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-999ce685-40ab-452b-8e64-0bf5beb82a4a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1674 microversion: 2.1 time: 0.550407 May 10 21:24:15.464030 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 264/529] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:14 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1674 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:15.500089 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-91dbd2f4-9865-4a11-a0a7-55e7ed50a485 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:15.500690 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-91dbd2f4-9865-4a11-a0a7-55e7ed50a485 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:15.507010 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-91dbd2f4-9865-4a11-a0a7-55e7ed50a485 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:15.507445 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-91dbd2f4-9865-4a11-a0a7-55e7ed50a485 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:15.508452 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-91dbd2f4-9865-4a11-a0a7-55e7ed50a485 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:15.508874 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-91dbd2f4-9865-4a11-a0a7-55e7ed50a485 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:15.522050 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.wsgi [None req-91dbd2f4-9865-4a11-a0a7-55e7ed50a485 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] HTTP exception thrown: Instance 9c94150b-0bc5-4635-b761-9f16d6f0b0a2 could not be found. May 10 21:24:15.523677 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-91dbd2f4-9865-4a11-a0a7-55e7ed50a485 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Request method failure captured: May 10 21:24:15.523677 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: request: GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2 HTTP/1.1 May 10 21:24:15.523677 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept: application/json May 10 21:24:15.523677 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept-Encoding: identity May 10 21:24:15.523677 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Connection: close May 10 21:24:15.523677 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Length: 0 May 10 21:24:15.523677 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Type: application/json May 10 21:24:15.523677 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Host: 10.222.0.25 May 10 21:24:15.523677 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Openstack-System-Scope: None May 10 21:24:15.523677 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: User-Agent: python-urllib3/1.26.9 May 10 21:24:15.523677 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Auth-Token: gAAAAABietccfViYRiOQpEa4ldvOHZyUgOQ2ZBBatS9SA20GCDt_AgmFvo4vE33WkYc6oqnMaRFSIYJbwKR_AxZ5OfoHdxsDJwPaySjCJQ5rrDhZmJbbtmsjCkN_RYEyYX6qvdoHvFk_bXj7SkSAx705IP0l1sxFz6bBTFTgIB8EAyrOf7pHKV8 May 10 21:24:15.523677 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Id: None May 10 21:24:15.523677 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Name: None May 10 21:24:15.523677 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Identity-Status: Confirmed May 10 21:24:15.523677 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Is-Admin-Project: True May 10 21:24:15.523677 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Id: default May 10 21:24:15.523677 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Name: Default May 10 21:24:15.523677 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Id: 8286226c580f4896aec72c65642fce30 May 10 21:24:15.523677 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Name: tempest-AttachVolumeNegativeTest-1863330069 May 10 21:24:15.523677 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Role: member,reader May 10 21:24:15.523677 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Roles: member,reader May 10 21:24:15.525229 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8286226c580f4896aec72c65642fce30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8286226c580f4896aec72c65642fce30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8286226c580f4896aec72c65642fce30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8286226c580f4896aec72c65642fce30"}]}] May 10 21:24:15.525229 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant: tempest-AttachVolumeNegativeTest-1863330069 May 10 21:24:15.525229 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Id: 8286226c580f4896aec72c65642fce30 May 10 21:24:15.525229 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1863330069 May 10 21:24:15.525229 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User: tempest-AttachVolumeNegativeTest-1863330069-project May 10 21:24:15.525229 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Id: default May 10 21:24:15.525229 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Name: Default May 10 21:24:15.525229 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Id: ca39678abe6e476283f94c675d4ea369 May 10 21:24:15.525229 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Name: tempest-AttachVolumeNegativeTest-1863330069-project May 10 21:24:15.525229 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: method: > May 10 21:24:15.525229 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: exception: Instance 9c94150b-0bc5-4635-b761-9f16d6f0b0a2 could not be found. May 10 21:24:15.525229 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: action_args: {'id': '9c94150b-0bc5-4635-b761-9f16d6f0b0a2'} May 10 21:24:15.529134 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:24:15.529134 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:24:15.529134 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:24:15.529134 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:24:15.529134 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:24:15.529134 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:24:15.529134 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:24:15.529134 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:24:15.529134 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:24:15.529134 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:24:15.529134 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c94150b-0bc5-4635-b761-9f16d6f0b0a2 could not be found. May 10 21:24:15.529134 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:24:15.529134 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:24:15.529134 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:24:15.529134 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:24:15.529134 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:24:15.529134 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:24:15.529134 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:24:15.529134 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:24:15.529134 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:24:15.530503 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:24:15.530503 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:24:15.530503 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:24:15.530503 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:24:15.530503 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:24:15.530503 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:24:15.530503 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:24:15.530503 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c94150b-0bc5-4635-b761-9f16d6f0b0a2 could not be found. May 10 21:24:15.530503 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:24:15.530503 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:24:15.530503 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:24:15.530503 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:24:15.530503 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:24:15.530503 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:24:15.530503 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:24:15.530503 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:24:15.530503 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c94150b-0bc5-4635-b761-9f16d6f0b0a2 could not be found. May 10 21:24:15.530503 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:24:15.531868 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-91dbd2f4-9865-4a11-a0a7-55e7ed50a485 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Returning 404 to user: Instance 9c94150b-0bc5-4635-b761-9f16d6f0b0a2 could not be found. {{(pid=117678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:24:15.531868 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-91dbd2f4-9865-4a11-a0a7-55e7ed50a485 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2" status: 404 len: 111 microversion: 2.1 time: 0.028780 May 10 21:24:15.531868 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 266/530] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:15 2022] GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:24:15.536366 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-069e8089-cbb2-4660-9e43-def6f33703b8 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '.version_select at 0x7f7aea53bdc0>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:15.585318 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-42fa8fb6-5364-4f7c-840c-e8b4e5bd2ef6 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:15.586178 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-42fa8fb6-5364-4f7c-840c-e8b4e5bd2ef6 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:15.592214 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-42fa8fb6-5364-4f7c-840c-e8b4e5bd2ef6 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:15.592681 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-42fa8fb6-5364-4f7c-840c-e8b4e5bd2ef6 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:15.593480 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-42fa8fb6-5364-4f7c-840c-e8b4e5bd2ef6 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:15.593912 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-42fa8fb6-5364-4f7c-840c-e8b4e5bd2ef6 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:15.606655 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-069e8089-cbb2-4660-9e43-def6f33703b8 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-565096298" status: 202 len: 0 microversion: 2.1 time: 0.075804 May 10 21:24:15.609520 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 265/531] 10.222.0.25 () {58 vars in 1217 bytes} [Tue May 10 21:24:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-565096298 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 21:24:15.792572 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-42fa8fb6-5364-4f7c-840c-e8b4e5bd2ef6 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:15.800363 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-42fa8fb6-5364-4f7c-840c-e8b4e5bd2ef6 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1724 microversion: 2.1 time: 0.218988 May 10 21:24:15.801455 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 267/532] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:15 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:16.432743 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6d98e6e2-35f8-432e-a658-12671ed0fe26 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Action: 'create', calling method: .version_select at 0x7f7aea46b310>, body: {"keypair": {"name": "tempest-keypair-1992666835", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICOOkjSRrzk9spBmSnpehaB8fEBFeHECRyd7QVq/leE0IMr5sDBlo1nwfqROEoVWo18WA8YlMN0IISoNPgqh4hYHAdHVomx4gQqvYWWLmXfPaas6lqlF+Hss4yQR8164g=="}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:24:16.450735 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-6d98e6e2-35f8-432e-a658-12671ed0fe26 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Getting quotas for project 8286226c580f4896aec72c65642fce30. Resources: {'key_pairs'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:24:16.454655 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-6d98e6e2-35f8-432e-a658-12671ed0fe26 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Getting quotas for user ca39678abe6e476283f94c675d4ea369 and project 8286226c580f4896aec72c65642fce30. Resources: {'key_pairs'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:24:16.480337 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-c4ca0bcb-f973-4965-a49d-432ee306f0d1 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:16.481078 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-c4ca0bcb-f973-4965-a49d-432ee306f0d1 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:16.486985 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c4ca0bcb-f973-4965-a49d-432ee306f0d1 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:16.487524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c4ca0bcb-f973-4965-a49d-432ee306f0d1 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:16.488287 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c4ca0bcb-f973-4965-a49d-432ee306f0d1 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:16.489497 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c4ca0bcb-f973-4965-a49d-432ee306f0d1 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:16.560854 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-6d98e6e2-35f8-432e-a658-12671ed0fe26 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.132695 May 10 21:24:16.561842 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 266/533] 10.222.0.25 () {60 vars in 1158 bytes} [Tue May 10 21:24:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:24:16.622111 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-c4ca0bcb-f973-4965-a49d-432ee306f0d1 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:16.629419 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-c4ca0bcb-f973-4965-a49d-432ee306f0d1 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1651 microversion: 2.1 time: 0.153093 May 10 21:24:16.630023 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 268/534] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:16 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1651 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:24:16.646534 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-0805f1d2-71f2-41e2-a78a-bd9b31d75244 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:24:16.652784 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0805f1d2-71f2-41e2-a78a-bd9b31d75244 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:16.653227 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0805f1d2-71f2-41e2-a78a-bd9b31d75244 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:16.675771 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-0805f1d2-71f2-41e2-a78a-bd9b31d75244 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Going to try to start instance {{(pid=117679) start /opt/stack/nova/nova/compute/api.py:2730}} May 10 21:24:16.817415 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-ab0d867b-9ebc-4bf1-b9b9-2afd60720dea tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:16.818023 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-ab0d867b-9ebc-4bf1-b9b9-2afd60720dea tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:16.825130 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-0805f1d2-71f2-41e2-a78a-bd9b31d75244 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "POST /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70/action" status: 202 len: 0 microversion: 2.1 time: 0.182948 May 10 21:24:16.825918 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 267/535] 10.222.0.25 () {60 vars in 1277 bytes} [Tue May 10 21:24:16 2022] POST /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 21:24:16.826941 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ab0d867b-9ebc-4bf1-b9b9-2afd60720dea tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:16.827485 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ab0d867b-9ebc-4bf1-b9b9-2afd60720dea tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:16.835429 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ab0d867b-9ebc-4bf1-b9b9-2afd60720dea tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:16.835429 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ab0d867b-9ebc-4bf1-b9b9-2afd60720dea tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:16.835998 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-9a18eeeb-6bac-4d69-94a9-90da007d1d70 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:16.836212 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-9a18eeeb-6bac-4d69-94a9-90da007d1d70 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:16.842668 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9a18eeeb-6bac-4d69-94a9-90da007d1d70 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:16.843122 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9a18eeeb-6bac-4d69-94a9-90da007d1d70 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:16.844453 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9a18eeeb-6bac-4d69-94a9-90da007d1d70 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:16.844453 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9a18eeeb-6bac-4d69-94a9-90da007d1d70 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:16.981179 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-ab0d867b-9ebc-4bf1-b9b9-2afd60720dea tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:16.983710 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-9a18eeeb-6bac-4d69-94a9-90da007d1d70 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:16.990341 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-ab0d867b-9ebc-4bf1-b9b9-2afd60720dea tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1724 microversion: 2.1 time: 0.176735 May 10 21:24:16.990944 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 269/536] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:16 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:24:16.992066 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-9a18eeeb-6bac-4d69-94a9-90da007d1d70 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1660 microversion: 2.1 time: 0.161709 May 10 21:24:16.992712 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 268/537] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:16 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1660 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:18.007741 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-f8306435-8a82-414c-b642-e2b11c703512 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:18.008680 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-f8306435-8a82-414c-b642-e2b11c703512 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:18.009289 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-d9ba417e-747d-4436-8ada-421f512ab72c tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:18.009892 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-d9ba417e-747d-4436-8ada-421f512ab72c tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:18.015221 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f8306435-8a82-414c-b642-e2b11c703512 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:18.015663 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f8306435-8a82-414c-b642-e2b11c703512 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:18.016333 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d9ba417e-747d-4436-8ada-421f512ab72c tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:18.016450 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f8306435-8a82-414c-b642-e2b11c703512 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:18.016798 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d9ba417e-747d-4436-8ada-421f512ab72c tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:18.017036 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f8306435-8a82-414c-b642-e2b11c703512 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:18.017555 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d9ba417e-747d-4436-8ada-421f512ab72c tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:18.018006 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d9ba417e-747d-4436-8ada-421f512ab72c tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:18.234170 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-d9ba417e-747d-4436-8ada-421f512ab72c tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:18.237580 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-f8306435-8a82-414c-b642-e2b11c703512 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:18.246119 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-d9ba417e-747d-4436-8ada-421f512ab72c tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1660 microversion: 2.1 time: 0.240872 May 10 21:24:18.246752 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 269/538] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:18 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1660 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:24:18.263570 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-f8306435-8a82-414c-b642-e2b11c703512 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1724 microversion: 2.1 time: 0.259930 May 10 21:24:18.264165 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 270/539] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:18 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1724 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:18.776998 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-9c2dd204-b15f-4204-86e6-e7fbaa5979ee tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-101866553", "imageRef": "2d72b3e0-7d02-481e-b5e6-17f44e8729d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3f280d19-4e21-4706-a61f-7c29f950ac00"}], "security_groups": [{"name": "tempest-securitygroup--1175072861"}], "key_name": "tempest-keypair-1992666835", "user_data": "}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:24:18.876843 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.network.neutron [None req-9c2dd204-b15f-4204-86e6-e7fbaa5979ee tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] validate_networks() for [('3f280d19-4e21-4706-a61f-7c29f950ac00', None, None, None, None, None)] {{(pid=117679) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 21:24:19.235875 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-9c2dd204-b15f-4204-86e6-e7fbaa5979ee tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Flavor limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 21:24:19.236433 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-9c2dd204-b15f-4204-86e6-e7fbaa5979ee tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Image limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 21:24:19.236754 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-9c2dd204-b15f-4204-86e6-e7fbaa5979ee tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Flavor pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 21:24:19.237162 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-9c2dd204-b15f-4204-86e6-e7fbaa5979ee tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Image pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 21:24:19.237568 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-9c2dd204-b15f-4204-86e6-e7fbaa5979ee tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 21:24:19.246119 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9c2dd204-b15f-4204-86e6-e7fbaa5979ee tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:19.246591 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9c2dd204-b15f-4204-86e6-e7fbaa5979ee tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:19.247391 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9c2dd204-b15f-4204-86e6-e7fbaa5979ee tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:19.247822 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9c2dd204-b15f-4204-86e6-e7fbaa5979ee tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:19.264924 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-d257a96e-ada4-43b4-a2fc-3de00e7b27cc tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:19.265455 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-9c2dd204-b15f-4204-86e6-e7fbaa5979ee tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Getting quotas for project 8286226c580f4896aec72c65642fce30. Resources: {'cores', 'instances', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:24:19.265579 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-d257a96e-ada4-43b4-a2fc-3de00e7b27cc tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:19.268908 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-9c2dd204-b15f-4204-86e6-e7fbaa5979ee tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Getting quotas for user ca39678abe6e476283f94c675d4ea369 and project 8286226c580f4896aec72c65642fce30. Resources: {'cores', 'instances', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:24:19.272622 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d257a96e-ada4-43b4-a2fc-3de00e7b27cc tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:19.273073 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d257a96e-ada4-43b4-a2fc-3de00e7b27cc tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:19.273850 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d257a96e-ada4-43b4-a2fc-3de00e7b27cc tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:19.274283 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d257a96e-ada4-43b4-a2fc-3de00e7b27cc tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:19.280328 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-9c2dd204-b15f-4204-86e6-e7fbaa5979ee tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Going to run 1 instances... {{(pid=117679) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 21:24:19.282633 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-9c2dd204-b15f-4204-86e6-e7fbaa5979ee tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 11411cb5-9de1-4ea1-8cdf-e770019076dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d72b3e0-7d02-481e-b5e6-17f44e8729d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 21:24:19.407365 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-d257a96e-ada4-43b4-a2fc-3de00e7b27cc tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:19.415059 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-d257a96e-ada4-43b4-a2fc-3de00e7b27cc tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1660 microversion: 2.1 time: 0.153963 May 10 21:24:19.424490 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 271/540] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:19 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1660 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:24:19.424490 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-37e19837-db79-4362-ad2a-5595d2b0ffd6 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:19.424490 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-37e19837-db79-4362-ad2a-5595d2b0ffd6 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:19.427515 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-37e19837-db79-4362-ad2a-5595d2b0ffd6 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:19.428195 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-9c2dd204-b15f-4204-86e6-e7fbaa5979ee tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.655317 May 10 21:24:19.428344 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-37e19837-db79-4362-ad2a-5595d2b0ffd6 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:19.429057 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-37e19837-db79-4362-ad2a-5595d2b0ffd6 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:19.429442 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 270/541] 10.222.0.25 () {60 vars in 1146 bytes} [Tue May 10 21:24:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 21:24:19.430119 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-37e19837-db79-4362-ad2a-5595d2b0ffd6 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:19.439320 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-c740d0ae-3a48-411d-99c2-cc4e307b6958 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:19.440102 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-c740d0ae-3a48-411d-99c2-cc4e307b6958 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 11411cb5-9de1-4ea1-8cdf-e770019076dc] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:19.496784 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-c740d0ae-3a48-411d-99c2-cc4e307b6958 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:19.504172 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-c740d0ae-3a48-411d-99c2-cc4e307b6958 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc" status: 200 len: 1241 microversion: 2.1 time: 0.068806 May 10 21:24:19.505659 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 271/542] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:19 2022] GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:24:19.574013 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-37e19837-db79-4362-ad2a-5595d2b0ffd6 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:19.593834 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-37e19837-db79-4362-ad2a-5595d2b0ffd6 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1730 microversion: 2.1 time: 0.174559 May 10 21:24:19.593834 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 272/543] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:19 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:19.608312 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-9b8fee02-778d-4970-ba6c-ad8656a70e44 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:19.608797 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-9b8fee02-778d-4970-ba6c-ad8656a70e44 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:19.615577 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9b8fee02-778d-4970-ba6c-ad8656a70e44 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:19.619841 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9b8fee02-778d-4970-ba6c-ad8656a70e44 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:19.619841 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9b8fee02-778d-4970-ba6c-ad8656a70e44 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:19.619841 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9b8fee02-778d-4970-ba6c-ad8656a70e44 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:19.699705 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-9b8fee02-778d-4970-ba6c-ad8656a70e44 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095159 May 10 21:24:19.700305 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 272/544] 10.222.0.25 () {58 vars in 1274 bytes} [Tue May 10 21:24:19 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:24:20.432058 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-785b3367-e1d9-41c3-ae57-74ab3cf01063 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:20.432831 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-785b3367-e1d9-41c3-ae57-74ab3cf01063 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:20.439422 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-785b3367-e1d9-41c3-ae57-74ab3cf01063 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:20.441043 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-785b3367-e1d9-41c3-ae57-74ab3cf01063 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:20.441043 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-785b3367-e1d9-41c3-ae57-74ab3cf01063 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:20.441043 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-785b3367-e1d9-41c3-ae57-74ab3cf01063 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:20.523853 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-52b7ec1f-8894-4273-b129-d68921d14b60 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:20.524993 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-52b7ec1f-8894-4273-b129-d68921d14b60 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 11411cb5-9de1-4ea1-8cdf-e770019076dc] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:20.531097 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-52b7ec1f-8894-4273-b129-d68921d14b60 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:20.531541 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-52b7ec1f-8894-4273-b129-d68921d14b60 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:20.532304 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-52b7ec1f-8894-4273-b129-d68921d14b60 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:20.532728 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-52b7ec1f-8894-4273-b129-d68921d14b60 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:20.599776 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-52b7ec1f-8894-4273-b129-d68921d14b60 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:20.607216 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-52b7ec1f-8894-4273-b129-d68921d14b60 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc" status: 200 len: 1237 microversion: 2.1 time: 0.089304 May 10 21:24:20.608252 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 273/545] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:20 2022] GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc => generated 1237 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:24:20.649724 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-785b3367-e1d9-41c3-ae57-74ab3cf01063 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:20.658045 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-785b3367-e1d9-41c3-ae57-74ab3cf01063 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1664 microversion: 2.1 time: 0.229869 May 10 21:24:20.658769 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 273/546] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:20 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1664 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:20.762275 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-004706e3-65d8-4634-9a32-5b053538f01c req-d588fc60-fd9c-44e3-ba25-64d22f26aace service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6abd4e9-f5fd-4413-9d26-808c47d618ab", "tag": "889c7cd8-c299-4d1a-a392-db09b20c9d47"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:24:20.770933 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-004706e3-65d8-4634-9a32-5b053538f01c req-d588fc60-fd9c-44e3-ba25-64d22f26aace service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:20.771395 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-004706e3-65d8-4634-9a32-5b053538f01c req-d588fc60-fd9c-44e3-ba25-64d22f26aace service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:20.782905 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-004706e3-65d8-4634-9a32-5b053538f01c req-d588fc60-fd9c-44e3-ba25-64d22f26aace service nova] Creating event network-changed:889c7cd8-c299-4d1a-a392-db09b20c9d47 for instance e6abd4e9-f5fd-4413-9d26-808c47d618ab on hv-cinder-83608 May 10 21:24:20.788699 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-004706e3-65d8-4634-9a32-5b053538f01c req-d588fc60-fd9c-44e3-ba25-64d22f26aace service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030128 May 10 21:24:20.789430 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 274/547] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:24:21.626530 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-258e025f-bca1-4f52-b1d4-74eab415dcb8 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:21.627105 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-258e025f-bca1-4f52-b1d4-74eab415dcb8 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 11411cb5-9de1-4ea1-8cdf-e770019076dc] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:21.640064 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-258e025f-bca1-4f52-b1d4-74eab415dcb8 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:21.641825 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-258e025f-bca1-4f52-b1d4-74eab415dcb8 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:21.641825 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-258e025f-bca1-4f52-b1d4-74eab415dcb8 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:21.642032 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-258e025f-bca1-4f52-b1d4-74eab415dcb8 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:21.718306 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-258e025f-bca1-4f52-b1d4-74eab415dcb8 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:21.729179 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-258e025f-bca1-4f52-b1d4-74eab415dcb8 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc" status: 200 len: 1311 microversion: 2.1 time: 0.106534 May 10 21:24:21.729933 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 274/548] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:21 2022] GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc => generated 1311 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:22.748228 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-43ac9b0f-8122-4317-acdb-d23e3add7cd4 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:22.748960 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-43ac9b0f-8122-4317-acdb-d23e3add7cd4 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 11411cb5-9de1-4ea1-8cdf-e770019076dc] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:22.755890 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-43ac9b0f-8122-4317-acdb-d23e3add7cd4 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:22.756341 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-43ac9b0f-8122-4317-acdb-d23e3add7cd4 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:22.757102 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-43ac9b0f-8122-4317-acdb-d23e3add7cd4 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:22.758408 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-43ac9b0f-8122-4317-acdb-d23e3add7cd4 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:22.805133 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-01732a81-2bdb-434a-907f-465cc2439245 req-44d83998-4080-44fa-8027-9bcf4d350627 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6abd4e9-f5fd-4413-9d26-808c47d618ab", "tag": "889c7cd8-c299-4d1a-a392-db09b20c9d47"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:24:22.818784 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-01732a81-2bdb-434a-907f-465cc2439245 req-44d83998-4080-44fa-8027-9bcf4d350627 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:22.819733 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-01732a81-2bdb-434a-907f-465cc2439245 req-44d83998-4080-44fa-8027-9bcf4d350627 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:22.832750 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-01732a81-2bdb-434a-907f-465cc2439245 req-44d83998-4080-44fa-8027-9bcf4d350627 service nova] Creating event network-changed:889c7cd8-c299-4d1a-a392-db09b20c9d47 for instance e6abd4e9-f5fd-4413-9d26-808c47d618ab on hv-cinder-83608 May 10 21:24:22.842520 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-01732a81-2bdb-434a-907f-465cc2439245 req-44d83998-4080-44fa-8027-9bcf4d350627 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040850 May 10 21:24:22.842520 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 275/549] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:24:23.028545 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-43ac9b0f-8122-4317-acdb-d23e3add7cd4 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:23.036917 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-43ac9b0f-8122-4317-acdb-d23e3add7cd4 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc" status: 200 len: 1367 microversion: 2.1 time: 0.292958 May 10 21:24:23.037499 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 275/550] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:22 2022] GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc => generated 1367 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:23.312265 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-3819044d-c4be-409b-a45e-c78d3f0c7d46 req-6f0ba219-625b-447b-a4d0-7011275b4f0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11411cb5-9de1-4ea1-8cdf-e770019076dc", "tag": "78364b55-7109-42ce-bcd5-a6a00acfab88"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:24:23.321256 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-3819044d-c4be-409b-a45e-c78d3f0c7d46 req-6f0ba219-625b-447b-a4d0-7011275b4f0b service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:23.321699 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-3819044d-c4be-409b-a45e-c78d3f0c7d46 req-6f0ba219-625b-447b-a4d0-7011275b4f0b service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:23.335808 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-3819044d-c4be-409b-a45e-c78d3f0c7d46 req-6f0ba219-625b-447b-a4d0-7011275b4f0b service nova] Creating event network-changed:78364b55-7109-42ce-bcd5-a6a00acfab88 for instance 11411cb5-9de1-4ea1-8cdf-e770019076dc on hv-cinder-83608 May 10 21:24:23.340908 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-3819044d-c4be-409b-a45e-c78d3f0c7d46 req-6f0ba219-625b-447b-a4d0-7011275b4f0b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032699 May 10 21:24:23.342485 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 276/551] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:24:24.054238 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-72e8a28e-68e1-4e6c-82ad-53c633db6341 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:24.054895 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-72e8a28e-68e1-4e6c-82ad-53c633db6341 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 11411cb5-9de1-4ea1-8cdf-e770019076dc] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:24.061541 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-72e8a28e-68e1-4e6c-82ad-53c633db6341 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:24.061979 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-72e8a28e-68e1-4e6c-82ad-53c633db6341 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:24.062777 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-72e8a28e-68e1-4e6c-82ad-53c633db6341 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:24.063201 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-72e8a28e-68e1-4e6c-82ad-53c633db6341 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:24.370800 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-72e8a28e-68e1-4e6c-82ad-53c633db6341 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:24.378052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-72e8a28e-68e1-4e6c-82ad-53c633db6341 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc" status: 200 len: 1367 microversion: 2.1 time: 0.328556 May 10 21:24:24.378665 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 276/552] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:24 2022] GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc => generated 1367 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:25.396968 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-a00b3631-3f67-4c5e-9d3d-87c78a0dfb1c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:25.397670 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-a00b3631-3f67-4c5e-9d3d-87c78a0dfb1c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 11411cb5-9de1-4ea1-8cdf-e770019076dc] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:25.404219 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-a00b3631-3f67-4c5e-9d3d-87c78a0dfb1c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:25.404667 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-a00b3631-3f67-4c5e-9d3d-87c78a0dfb1c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:25.405431 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-a00b3631-3f67-4c5e-9d3d-87c78a0dfb1c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:25.405862 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-a00b3631-3f67-4c5e-9d3d-87c78a0dfb1c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:25.534877 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-a00b3631-3f67-4c5e-9d3d-87c78a0dfb1c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:25.542085 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-a00b3631-3f67-4c5e-9d3d-87c78a0dfb1c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc" status: 200 len: 1367 microversion: 2.1 time: 0.149918 May 10 21:24:25.542700 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 277/553] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:25 2022] GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:26.559549 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-3cf5072a-1ee6-4651-9999-7b807c09e532 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:26.560257 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-3cf5072a-1ee6-4651-9999-7b807c09e532 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 11411cb5-9de1-4ea1-8cdf-e770019076dc] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:26.567402 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3cf5072a-1ee6-4651-9999-7b807c09e532 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:26.567945 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3cf5072a-1ee6-4651-9999-7b807c09e532 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:26.568707 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3cf5072a-1ee6-4651-9999-7b807c09e532 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:26.569135 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3cf5072a-1ee6-4651-9999-7b807c09e532 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:26.700342 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-3cf5072a-1ee6-4651-9999-7b807c09e532 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:26.708129 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-3cf5072a-1ee6-4651-9999-7b807c09e532 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc" status: 200 len: 1367 microversion: 2.1 time: 0.152102 May 10 21:24:26.708920 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 277/554] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:26 2022] GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:27.290328 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-dca7ae24-bce5-4b53-9eda-a0e2559e4b0f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:27.290898 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-dca7ae24-bce5-4b53-9eda-a0e2559e4b0f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:27.297187 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-dca7ae24-bce5-4b53-9eda-a0e2559e4b0f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:27.301854 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-dca7ae24-bce5-4b53-9eda-a0e2559e4b0f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:27.301854 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-dca7ae24-bce5-4b53-9eda-a0e2559e4b0f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:27.301854 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-dca7ae24-bce5-4b53-9eda-a0e2559e4b0f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:27.327315 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-dca7ae24-bce5-4b53-9eda-a0e2559e4b0f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869/os-volume_attachments/db60cfd4-341a-4be6-9fe6-dc5c5513580f" status: 200 len: 194 microversion: 2.20 time: 0.041307 May 10 21:24:27.327895 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 278/555] 10.222.0.25 () {60 vars in 1453 bytes} [Tue May 10 21:24:27 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869/os-volume_attachments/db60cfd4-341a-4be6-9fe6-dc5c5513580f => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:24:27.389054 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-0f497221-7b8b-458c-a9a7-c426bfb86dd4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:27.389571 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-0f497221-7b8b-458c-a9a7-c426bfb86dd4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:27.396724 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0f497221-7b8b-458c-a9a7-c426bfb86dd4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:27.397161 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0f497221-7b8b-458c-a9a7-c426bfb86dd4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:27.397921 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0f497221-7b8b-458c-a9a7-c426bfb86dd4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:27.398352 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0f497221-7b8b-458c-a9a7-c426bfb86dd4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:27.475839 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.objects.instance [None req-0f497221-7b8b-458c-a9a7-c426bfb86dd4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lazy-loading 'services' on Instance uuid ef19cfc2-aeb2-40ff-b25c-187304690869 {{(pid=117679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:24:27.724993 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-60e08827-77a5-4855-9b88-e08e99f1525f tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:27.725619 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-60e08827-77a5-4855-9b88-e08e99f1525f tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 11411cb5-9de1-4ea1-8cdf-e770019076dc] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:27.730617 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-0f497221-7b8b-458c-a9a7-c426bfb86dd4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869/os-volume_attachments/db60cfd4-341a-4be6-9fe6-dc5c5513580f" status: 202 len: 0 microversion: 2.20 time: 0.345546 May 10 21:24:27.731240 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 278/556] 10.222.0.25 () {60 vars in 1456 bytes} [Tue May 10 21:24:27 2022] DELETE /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869/os-volume_attachments/db60cfd4-341a-4be6-9fe6-dc5c5513580f => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 21:24:27.731631 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-60e08827-77a5-4855-9b88-e08e99f1525f tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:27.732046 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-60e08827-77a5-4855-9b88-e08e99f1525f tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:27.735965 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-60e08827-77a5-4855-9b88-e08e99f1525f tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:27.735965 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-60e08827-77a5-4855-9b88-e08e99f1525f tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:27.741889 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-c20cc5e1-f9b0-4ef1-9590-2e9085994cee tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:27.743037 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-c20cc5e1-f9b0-4ef1-9590-2e9085994cee tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:27.749516 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c20cc5e1-f9b0-4ef1-9590-2e9085994cee tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:27.749961 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c20cc5e1-f9b0-4ef1-9590-2e9085994cee tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:27.751096 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c20cc5e1-f9b0-4ef1-9590-2e9085994cee tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:27.751538 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c20cc5e1-f9b0-4ef1-9590-2e9085994cee tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:27.783263 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-c20cc5e1-f9b0-4ef1-9590-2e9085994cee tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047527 May 10 21:24:27.783825 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 279/557] 10.222.0.25 () {60 vars in 1342 bytes} [Tue May 10 21:24:27 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:24:27.867918 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-60e08827-77a5-4855-9b88-e08e99f1525f tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:27.875119 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-60e08827-77a5-4855-9b88-e08e99f1525f tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc" status: 200 len: 1367 microversion: 2.1 time: 0.154041 May 10 21:24:27.875675 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 279/558] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:27 2022] GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:24:28.795137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-25715157-0e83-4245-9360-fd7f5359ab51 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:28.795961 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-25715157-0e83-4245-9360-fd7f5359ab51 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:28.804000 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-25715157-0e83-4245-9360-fd7f5359ab51 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:28.804000 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-25715157-0e83-4245-9360-fd7f5359ab51 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:28.804211 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-25715157-0e83-4245-9360-fd7f5359ab51 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:28.804706 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-25715157-0e83-4245-9360-fd7f5359ab51 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:28.833492 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-25715157-0e83-4245-9360-fd7f5359ab51 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042401 May 10 21:24:28.834091 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 280/559] 10.222.0.25 () {60 vars in 1342 bytes} [Tue May 10 21:24:28 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:24:28.893758 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-9ba66c0e-c7a3-4d83-bbbe-0b04740f21c3 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:28.894500 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-9ba66c0e-c7a3-4d83-bbbe-0b04740f21c3 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 11411cb5-9de1-4ea1-8cdf-e770019076dc] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:28.901253 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9ba66c0e-c7a3-4d83-bbbe-0b04740f21c3 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:28.901770 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9ba66c0e-c7a3-4d83-bbbe-0b04740f21c3 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:28.907842 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9ba66c0e-c7a3-4d83-bbbe-0b04740f21c3 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:28.907842 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9ba66c0e-c7a3-4d83-bbbe-0b04740f21c3 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:29.036755 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-9ba66c0e-c7a3-4d83-bbbe-0b04740f21c3 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:29.044565 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-9ba66c0e-c7a3-4d83-bbbe-0b04740f21c3 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc" status: 200 len: 1367 microversion: 2.1 time: 0.155563 May 10 21:24:29.045126 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 280/560] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:28 2022] GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:29.663678 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-1ebae9d2-a194-4f0a-aa8c-e4e4b13e5faa tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:24:29.664531 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-1ebae9d2-a194-4f0a-aa8c-e4e4b13e5faa tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:29.670511 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1ebae9d2-a194-4f0a-aa8c-e4e4b13e5faa tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:29.670977 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1ebae9d2-a194-4f0a-aa8c-e4e4b13e5faa tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:29.671729 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1ebae9d2-a194-4f0a-aa8c-e4e4b13e5faa tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:29.672154 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1ebae9d2-a194-4f0a-aa8c-e4e4b13e5faa tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:29.820245 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-1ebae9d2-a194-4f0a-aa8c-e4e4b13e5faa tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "POST /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241/action" status: 202 len: 0 microversion: 2.1 time: 0.160431 May 10 21:24:29.820914 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 281/561] 10.222.0.25 () {60 vars in 1277 bytes} [Tue May 10 21:24:29 2022] POST /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 21:24:29.829079 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-c2316985-76c6-4fac-a313-5d1a53850fb9 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:29.829704 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-c2316985-76c6-4fac-a313-5d1a53850fb9 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:29.837528 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c2316985-76c6-4fac-a313-5d1a53850fb9 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:29.839589 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c2316985-76c6-4fac-a313-5d1a53850fb9 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:29.839589 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c2316985-76c6-4fac-a313-5d1a53850fb9 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:29.839589 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c2316985-76c6-4fac-a313-5d1a53850fb9 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:29.845204 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4eb9ec97-9c22-4154-97e2-418e4f0576f8 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:29.846211 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-4eb9ec97-9c22-4154-97e2-418e4f0576f8 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:29.852754 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4eb9ec97-9c22-4154-97e2-418e4f0576f8 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:29.856191 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4eb9ec97-9c22-4154-97e2-418e4f0576f8 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:29.856191 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4eb9ec97-9c22-4154-97e2-418e4f0576f8 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:29.856191 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4eb9ec97-9c22-4154-97e2-418e4f0576f8 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:29.885169 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4eb9ec97-9c22-4154-97e2-418e4f0576f8 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044273 May 10 21:24:29.885863 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 282/562] 10.222.0.25 () {60 vars in 1342 bytes} [Tue May 10 21:24:29 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:24:29.950245 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-64cc1216-3742-497e-9c44-7ca45e746b2b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:29.950998 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-64cc1216-3742-497e-9c44-7ca45e746b2b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:29.957187 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-64cc1216-3742-497e-9c44-7ca45e746b2b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:29.958355 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-64cc1216-3742-497e-9c44-7ca45e746b2b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:29.959164 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-64cc1216-3742-497e-9c44-7ca45e746b2b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:29.959779 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-64cc1216-3742-497e-9c44-7ca45e746b2b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:29.988393 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-64cc1216-3742-497e-9c44-7ca45e746b2b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Going to try to terminate instance {{(pid=117679) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 21:24:30.001929 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-c2316985-76c6-4fac-a313-5d1a53850fb9 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:30.011291 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-c2316985-76c6-4fac-a313-5d1a53850fb9 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1751 microversion: 2.1 time: 0.186192 May 10 21:24:30.011882 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 281/563] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:29 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1751 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:30.061110 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-05e57331-01e7-4945-a911-c4778239be6a tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:30.061849 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-05e57331-01e7-4945-a911-c4778239be6a tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 11411cb5-9de1-4ea1-8cdf-e770019076dc] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:30.068380 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-05e57331-01e7-4945-a911-c4778239be6a tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:30.068837 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-05e57331-01e7-4945-a911-c4778239be6a tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:30.069619 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-05e57331-01e7-4945-a911-c4778239be6a tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:30.070050 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-05e57331-01e7-4945-a911-c4778239be6a tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:30.200795 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-05e57331-01e7-4945-a911-c4778239be6a tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:30.212124 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-05e57331-01e7-4945-a911-c4778239be6a tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc" status: 200 len: 1367 microversion: 2.1 time: 0.151921 May 10 21:24:30.212124 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 282/564] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:30 2022] GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:24:30.246165 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-64cc1216-3742-497e-9c44-7ca45e746b2b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 204 len: 0 microversion: 2.20 time: 0.299443 May 10 21:24:30.246807 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 283/565] 10.222.0.25 () {60 vars in 1279 bytes} [Tue May 10 21:24:29 2022] DELETE /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 10 21:24:30.256071 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-8b813ea1-6291-4649-b140-792568fca93f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:30.256688 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-8b813ea1-6291-4649-b140-792568fca93f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:30.262877 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8b813ea1-6291-4649-b140-792568fca93f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:30.263325 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8b813ea1-6291-4649-b140-792568fca93f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:30.264100 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8b813ea1-6291-4649-b140-792568fca93f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:30.264535 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8b813ea1-6291-4649-b140-792568fca93f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:30.393876 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-8b813ea1-6291-4649-b140-792568fca93f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:30.402313 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-8b813ea1-6291-4649-b140-792568fca93f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:30.403831 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-8b813ea1-6291-4649-b140-792568fca93f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:30.405011 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-8b813ea1-6291-4649-b140-792568fca93f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1723 microversion: 2.20 time: 0.153846 May 10 21:24:30.405600 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 283/566] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:24:30 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:24:31.029344 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-39516e34-991e-4641-bb5b-3dacbc57cadf tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:31.030113 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-39516e34-991e-4641-bb5b-3dacbc57cadf tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:31.037235 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-39516e34-991e-4641-bb5b-3dacbc57cadf tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:31.037686 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-39516e34-991e-4641-bb5b-3dacbc57cadf tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:31.038515 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-39516e34-991e-4641-bb5b-3dacbc57cadf tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:31.038951 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-39516e34-991e-4641-bb5b-3dacbc57cadf tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:31.081387 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-9f96c6f1-670f-47d2-8498-ba71ca350890 req-f5e7e0ed-5851-464c-add2-368f072c4357 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11411cb5-9de1-4ea1-8cdf-e770019076dc", "name": "network-vif-plugged", "status": "completed", "tag": "78364b55-7109-42ce-bcd5-a6a00acfab88"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:24:31.090511 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-9f96c6f1-670f-47d2-8498-ba71ca350890 req-f5e7e0ed-5851-464c-add2-368f072c4357 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:31.090977 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-9f96c6f1-670f-47d2-8498-ba71ca350890 req-f5e7e0ed-5851-464c-add2-368f072c4357 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:31.104193 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-9f96c6f1-670f-47d2-8498-ba71ca350890 req-f5e7e0ed-5851-464c-add2-368f072c4357 service nova] Creating event network-vif-plugged:78364b55-7109-42ce-bcd5-a6a00acfab88 for instance 11411cb5-9de1-4ea1-8cdf-e770019076dc on hv-cinder-83608 May 10 21:24:31.109451 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-9f96c6f1-670f-47d2-8498-ba71ca350890 req-f5e7e0ed-5851-464c-add2-368f072c4357 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032392 May 10 21:24:31.110290 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 284/567] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:24:31.186186 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-39516e34-991e-4641-bb5b-3dacbc57cadf tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:31.194957 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-39516e34-991e-4641-bb5b-3dacbc57cadf tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1751 microversion: 2.1 time: 0.170057 May 10 21:24:31.195736 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 284/568] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:31 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1751 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:31.226565 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-d97f7f08-bbc2-4660-9f75-55863ea8f011 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:31.227260 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-d97f7f08-bbc2-4660-9f75-55863ea8f011 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 11411cb5-9de1-4ea1-8cdf-e770019076dc] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:31.233682 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d97f7f08-bbc2-4660-9f75-55863ea8f011 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:31.234119 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d97f7f08-bbc2-4660-9f75-55863ea8f011 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:31.234898 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d97f7f08-bbc2-4660-9f75-55863ea8f011 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:31.235325 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d97f7f08-bbc2-4660-9f75-55863ea8f011 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:31.362242 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-d97f7f08-bbc2-4660-9f75-55863ea8f011 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:31.369854 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-d97f7f08-bbc2-4660-9f75-55863ea8f011 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc" status: 200 len: 1367 microversion: 2.1 time: 0.148507 May 10 21:24:31.370417 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 285/569] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:31 2022] GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:31.423441 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-def4501b-7526-422e-9230-c5faa8d43012 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:31.424049 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-def4501b-7526-422e-9230-c5faa8d43012 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:31.430570 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-def4501b-7526-422e-9230-c5faa8d43012 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:31.431016 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-def4501b-7526-422e-9230-c5faa8d43012 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:31.431781 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-def4501b-7526-422e-9230-c5faa8d43012 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:31.432210 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-def4501b-7526-422e-9230-c5faa8d43012 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:31.558534 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-def4501b-7526-422e-9230-c5faa8d43012 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:31.566122 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-def4501b-7526-422e-9230-c5faa8d43012 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:31.568297 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-def4501b-7526-422e-9230-c5faa8d43012 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:31.569431 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-def4501b-7526-422e-9230-c5faa8d43012 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1723 microversion: 2.20 time: 0.149866 May 10 21:24:31.569992 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 285/570] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:24:31 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:24:32.215028 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-156bc417-4717-4a56-91ea-5aa4dc55bd6c tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:32.219733 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-156bc417-4717-4a56-91ea-5aa4dc55bd6c tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:32.222042 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-156bc417-4717-4a56-91ea-5aa4dc55bd6c tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:32.222533 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-156bc417-4717-4a56-91ea-5aa4dc55bd6c tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:32.224075 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-156bc417-4717-4a56-91ea-5aa4dc55bd6c tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:32.224570 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-156bc417-4717-4a56-91ea-5aa4dc55bd6c tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:32.368647 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-156bc417-4717-4a56-91ea-5aa4dc55bd6c tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:32.376615 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-156bc417-4717-4a56-91ea-5aa4dc55bd6c tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1756 microversion: 2.1 time: 0.165771 May 10 21:24:32.377186 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 286/571] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:32 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:24:32.386811 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-280fd23f-f1cd-4248-93f5-4dcbf53773e7 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:32.387419 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-280fd23f-f1cd-4248-93f5-4dcbf53773e7 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 11411cb5-9de1-4ea1-8cdf-e770019076dc] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:32.393948 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-280fd23f-f1cd-4248-93f5-4dcbf53773e7 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:32.394394 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-280fd23f-f1cd-4248-93f5-4dcbf53773e7 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:32.395849 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-280fd23f-f1cd-4248-93f5-4dcbf53773e7 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:32.396484 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-280fd23f-f1cd-4248-93f5-4dcbf53773e7 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:32.588328 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-3f9e061d-bef0-4e6c-860d-e400dbde17f4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:32.588924 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-3f9e061d-bef0-4e6c-860d-e400dbde17f4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:32.594805 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3f9e061d-bef0-4e6c-860d-e400dbde17f4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:32.595255 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3f9e061d-bef0-4e6c-860d-e400dbde17f4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:32.596015 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3f9e061d-bef0-4e6c-860d-e400dbde17f4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:32.596444 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3f9e061d-bef0-4e6c-860d-e400dbde17f4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:32.625719 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-280fd23f-f1cd-4248-93f5-4dcbf53773e7 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:32.634735 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-280fd23f-f1cd-4248-93f5-4dcbf53773e7 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc" status: 200 len: 1367 microversion: 2.1 time: 0.252072 May 10 21:24:32.642499 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 286/572] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:32 2022] GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:32.724676 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-3f9e061d-bef0-4e6c-860d-e400dbde17f4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:32.733246 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-3f9e061d-bef0-4e6c-860d-e400dbde17f4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:32.734746 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-3f9e061d-bef0-4e6c-860d-e400dbde17f4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:32.736006 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-3f9e061d-bef0-4e6c-860d-e400dbde17f4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1723 microversion: 2.20 time: 0.151510 May 10 21:24:32.736583 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 287/573] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:24:32 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:24:33.210287 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-6459bd8d-8e7b-4414-802b-1d873df8c060 req-d24d4c6f-031a-4d51-b0e8-dd4b1f8dd0b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef19cfc2-aeb2-40ff-b25c-187304690869", "name": "network-vif-deleted", "tag": "83ef924d-2caa-4d5a-8fb2-cd0a871c9712"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:24:33.219894 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-6459bd8d-8e7b-4414-802b-1d873df8c060 req-d24d4c6f-031a-4d51-b0e8-dd4b1f8dd0b0 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:33.220518 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-6459bd8d-8e7b-4414-802b-1d873df8c060 req-d24d4c6f-031a-4d51-b0e8-dd4b1f8dd0b0 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:33.232443 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-6459bd8d-8e7b-4414-802b-1d873df8c060 req-d24d4c6f-031a-4d51-b0e8-dd4b1f8dd0b0 service nova] Creating event network-vif-deleted:83ef924d-2caa-4d5a-8fb2-cd0a871c9712 for instance ef19cfc2-aeb2-40ff-b25c-187304690869 on hv-cinder-83608 May 10 21:24:33.237501 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-6459bd8d-8e7b-4414-802b-1d873df8c060 req-d24d4c6f-031a-4d51-b0e8-dd4b1f8dd0b0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031125 May 10 21:24:33.242045 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 287/574] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:24:33.395431 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-4c160767-87d8-448d-babd-e8df839bde41 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:33.396035 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-4c160767-87d8-448d-babd-e8df839bde41 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:33.410249 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4c160767-87d8-448d-babd-e8df839bde41 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:33.410249 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4c160767-87d8-448d-babd-e8df839bde41 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:33.410249 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4c160767-87d8-448d-babd-e8df839bde41 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:33.410249 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4c160767-87d8-448d-babd-e8df839bde41 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:33.555325 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-4c160767-87d8-448d-babd-e8df839bde41 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:33.563212 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-4c160767-87d8-448d-babd-e8df839bde41 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1756 microversion: 2.1 time: 0.172781 May 10 21:24:33.563876 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 288/575] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:33 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:33.653787 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-dedd6adb-7b67-49af-af06-26b939d52843 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:33.654517 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-dedd6adb-7b67-49af-af06-26b939d52843 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 11411cb5-9de1-4ea1-8cdf-e770019076dc] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:33.661149 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dedd6adb-7b67-49af-af06-26b939d52843 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:33.661513 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dedd6adb-7b67-49af-af06-26b939d52843 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:33.662297 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dedd6adb-7b67-49af-af06-26b939d52843 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:33.662757 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dedd6adb-7b67-49af-af06-26b939d52843 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:33.755974 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-fd363b5e-c597-4d70-8104-d23a1cae232b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:33.756731 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-fd363b5e-c597-4d70-8104-d23a1cae232b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:33.763885 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-fd363b5e-c597-4d70-8104-d23a1cae232b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:33.764550 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-fd363b5e-c597-4d70-8104-d23a1cae232b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:33.765323 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-fd363b5e-c597-4d70-8104-d23a1cae232b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:33.765749 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-fd363b5e-c597-4d70-8104-d23a1cae232b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:33.798462 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-fd363b5e-c597-4d70-8104-d23a1cae232b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:33.798911 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-fd363b5e-c597-4d70-8104-d23a1cae232b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:33.799379 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.objects.instance [None req-fd363b5e-c597-4d70-8104-d23a1cae232b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lazy-loading 'fault' on Instance uuid ef19cfc2-aeb2-40ff-b25c-187304690869 {{(pid=117678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:24:33.804135 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-dedd6adb-7b67-49af-af06-26b939d52843 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:33.812927 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-dedd6adb-7b67-49af-af06-26b939d52843 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc" status: 200 len: 1367 microversion: 2.1 time: 0.163907 May 10 21:24:33.813786 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 288/576] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:33 2022] GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:33.844639 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-fd363b5e-c597-4d70-8104-d23a1cae232b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:33.853035 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-fd363b5e-c597-4d70-8104-d23a1cae232b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:33.854687 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-fd363b5e-c597-4d70-8104-d23a1cae232b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:33.855966 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-fd363b5e-c597-4d70-8104-d23a1cae232b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 200 len: 1371 microversion: 2.20 time: 0.104212 May 10 21:24:33.856625 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 289/577] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:24:33 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 1371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:24:34.580744 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-07309bae-2559-4bb5-b235-d3fc54cc1f32 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:34.581318 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-07309bae-2559-4bb5-b235-d3fc54cc1f32 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:34.587991 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-07309bae-2559-4bb5-b235-d3fc54cc1f32 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:34.588439 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-07309bae-2559-4bb5-b235-d3fc54cc1f32 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:34.592917 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-07309bae-2559-4bb5-b235-d3fc54cc1f32 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:34.592917 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-07309bae-2559-4bb5-b235-d3fc54cc1f32 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:34.732186 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-07309bae-2559-4bb5-b235-d3fc54cc1f32 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:34.740830 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-07309bae-2559-4bb5-b235-d3fc54cc1f32 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1756 microversion: 2.1 time: 0.164003 May 10 21:24:34.741418 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 289/578] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:34 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:34.830896 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-8eb5f560-0554-4dfb-bc16-dc3b85534a1e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:34.831965 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-8eb5f560-0554-4dfb-bc16-dc3b85534a1e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 11411cb5-9de1-4ea1-8cdf-e770019076dc] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:34.840076 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8eb5f560-0554-4dfb-bc16-dc3b85534a1e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:34.840524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8eb5f560-0554-4dfb-bc16-dc3b85534a1e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:34.841299 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8eb5f560-0554-4dfb-bc16-dc3b85534a1e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:34.841729 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8eb5f560-0554-4dfb-bc16-dc3b85534a1e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:34.875357 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6ba8dc4f-d8dc-44e3-ac34-850f2e0e2591 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:34.876131 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-6ba8dc4f-d8dc-44e3-ac34-850f2e0e2591 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:34.882871 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6ba8dc4f-d8dc-44e3-ac34-850f2e0e2591 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:34.883312 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6ba8dc4f-d8dc-44e3-ac34-850f2e0e2591 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:34.884362 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6ba8dc4f-d8dc-44e3-ac34-850f2e0e2591 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:34.884831 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6ba8dc4f-d8dc-44e3-ac34-850f2e0e2591 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:34.898559 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-6ba8dc4f-d8dc-44e3-ac34-850f2e0e2591 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] HTTP exception thrown: Instance ef19cfc2-aeb2-40ff-b25c-187304690869 could not be found. May 10 21:24:34.900234 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6ba8dc4f-d8dc-44e3-ac34-850f2e0e2591 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Request method failure captured: May 10 21:24:34.900234 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: request: GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 HTTP/1.1 May 10 21:24:34.900234 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept: application/json May 10 21:24:34.900234 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity May 10 21:24:34.900234 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Connection: close May 10 21:24:34.900234 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Length: 0 May 10 21:24:34.900234 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Type: application/json May 10 21:24:34.900234 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Host: 10.222.0.25 May 10 21:24:34.900234 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None May 10 21:24:34.900234 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 May 10 21:24:34.900234 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABietcfe6lMeI8-tGr-6bZXprKhi7Y65KdAEgIkIrPxMDTWh3KcswzlZ_JOKGUeGCbiaxdNeo01Bu4eTUznNFUCVsrw5fiiJio5O_H1b9vjdbI5TidmADrY3b1ZIBtthDKQXf5C4AptPGAjqEBECYCxJC4JzhtcpaiOtPRTbGJHAPt3tCU May 10 21:24:34.900234 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Id: None May 10 21:24:34.900234 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Name: None May 10 21:24:34.900234 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed May 10 21:24:34.900234 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True May 10 21:24:34.900234 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Openstack-Nova-Api-Version: 2.20 May 10 21:24:34.900234 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default May 10 21:24:34.900234 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default May 10 21:24:34.900234 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Id: 802e2ef29f6f4b2c8ca69204b69cc142 May 10 21:24:34.900234 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-31474631 May 10 21:24:34.900234 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Role: member,reader May 10 21:24:34.900234 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Roles: member,reader May 10 21:24:34.902004 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/802e2ef29f6f4b2c8ca69204b69cc142"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_802e2ef29f6f4b2c8ca69204b69cc142"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/802e2ef29f6f4b2c8ca69204b69cc142"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/802e2ef29f6f4b2c8ca69204b69cc142"}]}] May 10 21:24:34.902004 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-AttachVolumeShelveTestJSON-31474631 May 10 21:24:34.902004 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Id: 802e2ef29f6f4b2c8ca69204b69cc142 May 10 21:24:34.902004 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-31474631 May 10 21:24:34.902004 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User: tempest-AttachVolumeShelveTestJSON-31474631-project May 10 21:24:34.902004 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default May 10 21:24:34.902004 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default May 10 21:24:34.902004 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Id: d2267b0c3311480eb8d1f54df5296c4c May 10 21:24:34.902004 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-AttachVolumeShelveTestJSON-31474631-project May 10 21:24:34.902004 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: method: > May 10 21:24:34.902004 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: exception: Instance ef19cfc2-aeb2-40ff-b25c-187304690869 could not be found. May 10 21:24:34.902004 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: action_args: {'id': 'ef19cfc2-aeb2-40ff-b25c-187304690869'} May 10 21:24:34.902932 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:24:34.902932 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:24:34.902932 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:24:34.902932 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:24:34.902932 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:24:34.902932 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:24:34.902932 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:24:34.902932 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:24:34.902932 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:24:34.902932 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:24:34.902932 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef19cfc2-aeb2-40ff-b25c-187304690869 could not be found. May 10 21:24:34.902932 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:24:34.902932 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:24:34.902932 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:24:34.902932 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:24:34.902932 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:24:34.902932 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:24:34.902932 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:24:34.902932 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:24:34.902932 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:24:34.904306 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:24:34.904306 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:24:34.904306 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:24:34.904306 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:24:34.904306 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:24:34.904306 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:24:34.904306 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:24:34.904306 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef19cfc2-aeb2-40ff-b25c-187304690869 could not be found. May 10 21:24:34.904306 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:24:34.904306 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:24:34.904306 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:24:34.904306 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:24:34.904306 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:24:34.904306 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:24:34.904306 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:24:34.904306 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:24:34.904306 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef19cfc2-aeb2-40ff-b25c-187304690869 could not be found. May 10 21:24:34.904306 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:24:34.905551 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6ba8dc4f-d8dc-44e3-ac34-850f2e0e2591 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Returning 404 to user: Instance ef19cfc2-aeb2-40ff-b25c-187304690869 could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:24:34.905551 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-6ba8dc4f-d8dc-44e3-ac34-850f2e0e2591 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 404 len: 111 microversion: 2.20 time: 0.030377 May 10 21:24:34.905551 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 290/579] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:24:34 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 10 21:24:34.911390 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-aca24ade-f20b-46b4-8859-964ba34bf3ca tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '.version_select at 0x7f7aea4030d0>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:34.976648 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-8eb5f560-0554-4dfb-bc16-dc3b85534a1e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:34.983562 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-aca24ade-f20b-46b4-8859-964ba34bf3ca tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-163365215" status: 204 len: 0 microversion: 2.20 time: 0.077018 May 10 21:24:34.984019 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-8eb5f560-0554-4dfb-bc16-dc3b85534a1e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc" status: 200 len: 1558 microversion: 2.1 time: 0.158886 May 10 21:24:34.984131 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 291/580] 10.222.0.25 () {60 vars in 1258 bytes} [Tue May 10 21:24:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-163365215 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 10 21:24:34.984581 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 290/581] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:34 2022] GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:35.001212 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-88b5d54f-681f-4ac8-8333-b9879f2db4c6 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:35.001820 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-88b5d54f-681f-4ac8-8333-b9879f2db4c6 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 11411cb5-9de1-4ea1-8cdf-e770019076dc] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:35.007794 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-88b5d54f-681f-4ac8-8333-b9879f2db4c6 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:35.008323 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-88b5d54f-681f-4ac8-8333-b9879f2db4c6 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:35.009363 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-88b5d54f-681f-4ac8-8333-b9879f2db4c6 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:35.009793 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-88b5d54f-681f-4ac8-8333-b9879f2db4c6 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:35.111624 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-88b5d54f-681f-4ac8-8333-b9879f2db4c6 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.114284 May 10 21:24:35.112299 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 292/582] 10.222.0.25 () {58 vars in 1274 bytes} [Tue May 10 21:24:34 2022] GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc/os-interface => generated 285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:24:35.757613 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-6e5d9c56-02bf-4d27-89d1-58aab4e66891 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:35.758226 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-6e5d9c56-02bf-4d27-89d1-58aab4e66891 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:35.766160 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-65854ee9-f343-4823-9f96-5affb4d9385f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Action: 'create', calling method: .version_select at 0x7f7aea551d30>, body: {"keypair": {"name": "tempest-keypair-218098278", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsDwhpfGRL4Zs41zkxZOoXGbwRMuWuESKe/dQ3PAv4YKzzfHktbmtzi+yPL7K2+3ACayccLznmCT7avMc8dM3dZE7AIR4x6LtrY+w+EM7xkmqS/GgSd8jKNqCcwD+8Nzw=="}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:24:35.775313 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6e5d9c56-02bf-4d27-89d1-58aab4e66891 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:35.775765 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6e5d9c56-02bf-4d27-89d1-58aab4e66891 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:35.776542 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6e5d9c56-02bf-4d27-89d1-58aab4e66891 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:35.779846 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6e5d9c56-02bf-4d27-89d1-58aab4e66891 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:35.788131 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-65854ee9-f343-4823-9f96-5affb4d9385f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Getting quotas for project 802e2ef29f6f4b2c8ca69204b69cc142. Resources: {'key_pairs'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:24:35.794394 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-65854ee9-f343-4823-9f96-5affb4d9385f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Getting quotas for user d2267b0c3311480eb8d1f54df5296c4c and project 802e2ef29f6f4b2c8ca69204b69cc142. Resources: {'key_pairs'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:24:35.887092 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-65854ee9-f343-4823-9f96-5affb4d9385f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.125008 May 10 21:24:35.887787 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 293/583] 10.222.0.25 () {62 vars in 1199 bytes} [Tue May 10 21:24:35 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 126 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 10 21:24:35.961884 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-6e5d9c56-02bf-4d27-89d1-58aab4e66891 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:35.969683 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-6e5d9c56-02bf-4d27-89d1-58aab4e66891 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1756 microversion: 2.1 time: 0.216408 May 10 21:24:35.970260 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 291/584] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:35 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1756 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:36.461478 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-33eb493a-b60e-49bc-a015-6725a7ecebed req-f273c556-8673-4530-b181-c065e962142f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11411cb5-9de1-4ea1-8cdf-e770019076dc", "tag": "78364b55-7109-42ce-bcd5-a6a00acfab88"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:24:36.469531 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-33eb493a-b60e-49bc-a015-6725a7ecebed req-f273c556-8673-4530-b181-c065e962142f service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:36.471064 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-33eb493a-b60e-49bc-a015-6725a7ecebed req-f273c556-8673-4530-b181-c065e962142f service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:36.488552 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-33eb493a-b60e-49bc-a015-6725a7ecebed req-f273c556-8673-4530-b181-c065e962142f service nova] Creating event network-changed:78364b55-7109-42ce-bcd5-a6a00acfab88 for instance 11411cb5-9de1-4ea1-8cdf-e770019076dc on hv-cinder-83608 May 10 21:24:36.494816 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-33eb493a-b60e-49bc-a015-6725a7ecebed req-f273c556-8673-4530-b181-c065e962142f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037795 May 10 21:24:36.495510 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 294/585] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:24:36.987530 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-34a3fc8b-d456-411d-8b63-45269bdbcbf0 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:36.989518 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-34a3fc8b-d456-411d-8b63-45269bdbcbf0 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:36.996419 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-34a3fc8b-d456-411d-8b63-45269bdbcbf0 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:36.996864 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-34a3fc8b-d456-411d-8b63-45269bdbcbf0 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:36.997746 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-34a3fc8b-d456-411d-8b63-45269bdbcbf0 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:36.998549 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-34a3fc8b-d456-411d-8b63-45269bdbcbf0 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:37.219854 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-34a3fc8b-d456-411d-8b63-45269bdbcbf0 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:37.229830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-34a3fc8b-d456-411d-8b63-45269bdbcbf0 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1756 microversion: 2.1 time: 0.246309 May 10 21:24:37.230428 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 292/586] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:36 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1756 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:38.124911 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-72224934-6618-4d04-a1d5-e63a36eb99e9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1122338538", "imageRef": "2d72b3e0-7d02-481e-b5e6-17f44e8729d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "169df5df-f41d-4a2b-9d9a-2bdd14f9c862"}], "security_groups": [{"name": "tempest-securitygroup--2024917652"}], "key_name": "tempest-keypair-218098278", "user_data": "}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:24:38.224995 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.network.neutron [None req-72224934-6618-4d04-a1d5-e63a36eb99e9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] validate_networks() for [('169df5df-f41d-4a2b-9d9a-2bdd14f9c862', None, None, None, None, None)] {{(pid=117679) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 21:24:38.247121 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-35ca036b-7c85-4b7f-8c6a-9cf225ddb743 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:38.247721 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-35ca036b-7c85-4b7f-8c6a-9cf225ddb743 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:38.254195 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-35ca036b-7c85-4b7f-8c6a-9cf225ddb743 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:38.254768 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-35ca036b-7c85-4b7f-8c6a-9cf225ddb743 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:38.255597 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-35ca036b-7c85-4b7f-8c6a-9cf225ddb743 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:38.256025 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-35ca036b-7c85-4b7f-8c6a-9cf225ddb743 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:38.402097 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-35ca036b-7c85-4b7f-8c6a-9cf225ddb743 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:38.409856 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-35ca036b-7c85-4b7f-8c6a-9cf225ddb743 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1756 microversion: 2.1 time: 0.166495 May 10 21:24:38.410451 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 293/587] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:38 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:24:38.586124 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-72224934-6618-4d04-a1d5-e63a36eb99e9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Flavor limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 21:24:38.586590 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-72224934-6618-4d04-a1d5-e63a36eb99e9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Image limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 21:24:38.587064 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-72224934-6618-4d04-a1d5-e63a36eb99e9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Flavor pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 21:24:38.587466 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-72224934-6618-4d04-a1d5-e63a36eb99e9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Image pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 21:24:38.587870 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-72224934-6618-4d04-a1d5-e63a36eb99e9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 21:24:38.596361 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-72224934-6618-4d04-a1d5-e63a36eb99e9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:38.596800 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-72224934-6618-4d04-a1d5-e63a36eb99e9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:38.597596 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-72224934-6618-4d04-a1d5-e63a36eb99e9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:38.598028 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-72224934-6618-4d04-a1d5-e63a36eb99e9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:38.614513 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-72224934-6618-4d04-a1d5-e63a36eb99e9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Getting quotas for project 802e2ef29f6f4b2c8ca69204b69cc142. Resources: {'cores', 'instances', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:24:38.618503 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-72224934-6618-4d04-a1d5-e63a36eb99e9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Getting quotas for user d2267b0c3311480eb8d1f54df5296c4c and project 802e2ef29f6f4b2c8ca69204b69cc142. Resources: {'cores', 'instances', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:24:38.629983 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-72224934-6618-4d04-a1d5-e63a36eb99e9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Going to run 1 instances... {{(pid=117679) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 21:24:38.632152 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-72224934-6618-4d04-a1d5-e63a36eb99e9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d72b3e0-7d02-481e-b5e6-17f44e8729d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 21:24:38.767424 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-72224934-6618-4d04-a1d5-e63a36eb99e9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.647611 May 10 21:24:38.767994 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 295/588] 10.222.0.25 () {62 vars in 1187 bytes} [Tue May 10 21:24:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 10 21:24:38.778991 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-12449a59-bcee-418e-827a-c06921fa6357 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:38.779666 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-12449a59-bcee-418e-827a-c06921fa6357 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:38.832161 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-12449a59-bcee-418e-827a-c06921fa6357 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:38.840224 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-12449a59-bcee-418e-827a-c06921fa6357 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:38.841721 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-12449a59-bcee-418e-827a-c06921fa6357 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:38.842856 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-12449a59-bcee-418e-827a-c06921fa6357 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1281 microversion: 2.20 time: 0.067726 May 10 21:24:38.843596 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 294/589] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:24:38 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1281 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:24:39.428814 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a2368ce9-ba52-4f91-8b92-4eb7aeed5f16 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:39.429421 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-a2368ce9-ba52-4f91-8b92-4eb7aeed5f16 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:39.436388 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a2368ce9-ba52-4f91-8b92-4eb7aeed5f16 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:39.436856 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a2368ce9-ba52-4f91-8b92-4eb7aeed5f16 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:39.437620 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a2368ce9-ba52-4f91-8b92-4eb7aeed5f16 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:39.438051 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a2368ce9-ba52-4f91-8b92-4eb7aeed5f16 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:39.582637 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-a2368ce9-ba52-4f91-8b92-4eb7aeed5f16 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:39.590773 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-a2368ce9-ba52-4f91-8b92-4eb7aeed5f16 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1756 microversion: 2.1 time: 0.167234 May 10 21:24:39.593998 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 296/590] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:39 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:39.861134 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-eda08fbd-3121-486d-8010-69433bd193ea tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:39.861832 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-eda08fbd-3121-486d-8010-69433bd193ea tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:39.869208 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-eda08fbd-3121-486d-8010-69433bd193ea tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:39.869654 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-eda08fbd-3121-486d-8010-69433bd193ea tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:39.870431 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-eda08fbd-3121-486d-8010-69433bd193ea tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:39.870890 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-eda08fbd-3121-486d-8010-69433bd193ea tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:39.931232 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-eda08fbd-3121-486d-8010-69433bd193ea tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:39.939095 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-eda08fbd-3121-486d-8010-69433bd193ea tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:39.947884 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-eda08fbd-3121-486d-8010-69433bd193ea tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:39.947884 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-eda08fbd-3121-486d-8010-69433bd193ea tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1277 microversion: 2.20 time: 0.084492 May 10 21:24:39.947884 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 295/591] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:24:39 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1277 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:24:40.608478 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-dccbf600-78f9-4080-b68c-ad241b04877d tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:40.611970 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-dccbf600-78f9-4080-b68c-ad241b04877d tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:40.616498 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dccbf600-78f9-4080-b68c-ad241b04877d tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:40.616937 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dccbf600-78f9-4080-b68c-ad241b04877d tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:40.617706 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dccbf600-78f9-4080-b68c-ad241b04877d tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:40.618142 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dccbf600-78f9-4080-b68c-ad241b04877d tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:40.823963 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-dccbf600-78f9-4080-b68c-ad241b04877d tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:40.831777 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-dccbf600-78f9-4080-b68c-ad241b04877d tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1756 microversion: 2.1 time: 0.227231 May 10 21:24:40.835635 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 297/592] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:40 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1756 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:40.960506 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-8a25e602-4fbe-46f7-8100-b17f2267285e tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:40.961117 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-8a25e602-4fbe-46f7-8100-b17f2267285e tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:40.967509 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8a25e602-4fbe-46f7-8100-b17f2267285e tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:40.967958 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8a25e602-4fbe-46f7-8100-b17f2267285e tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:40.968727 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8a25e602-4fbe-46f7-8100-b17f2267285e tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:40.969162 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8a25e602-4fbe-46f7-8100-b17f2267285e tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:41.030674 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-8a25e602-4fbe-46f7-8100-b17f2267285e tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:41.039180 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-8a25e602-4fbe-46f7-8100-b17f2267285e tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:41.040667 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-8a25e602-4fbe-46f7-8100-b17f2267285e tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:41.041763 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-8a25e602-4fbe-46f7-8100-b17f2267285e tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1339 microversion: 2.20 time: 0.085429 May 10 21:24:41.042326 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 296/593] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:24:40 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1339 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:24:41.848696 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-cdf121b1-fed2-4b09-a2f9-0758dbf26ff2 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:41.849316 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-cdf121b1-fed2-4b09-a2f9-0758dbf26ff2 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:41.856653 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cdf121b1-fed2-4b09-a2f9-0758dbf26ff2 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:41.857106 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cdf121b1-fed2-4b09-a2f9-0758dbf26ff2 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:41.857894 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cdf121b1-fed2-4b09-a2f9-0758dbf26ff2 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:41.858331 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cdf121b1-fed2-4b09-a2f9-0758dbf26ff2 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:42.060361 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-057220fb-225b-4eb7-8265-1d9cf5265f40 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:42.060971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-057220fb-225b-4eb7-8265-1d9cf5265f40 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:42.067484 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-057220fb-225b-4eb7-8265-1d9cf5265f40 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:42.067928 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-057220fb-225b-4eb7-8265-1d9cf5265f40 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:42.068706 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-057220fb-225b-4eb7-8265-1d9cf5265f40 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:42.069794 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-057220fb-225b-4eb7-8265-1d9cf5265f40 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:42.143477 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-cdf121b1-fed2-4b09-a2f9-0758dbf26ff2 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:42.151785 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-cdf121b1-fed2-4b09-a2f9-0758dbf26ff2 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1756 microversion: 2.1 time: 0.306947 May 10 21:24:42.152370 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 298/594] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:41 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1756 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:42.199157 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-057220fb-225b-4eb7-8265-1d9cf5265f40 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:42.207206 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-057220fb-225b-4eb7-8265-1d9cf5265f40 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:42.208932 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-057220fb-225b-4eb7-8265-1d9cf5265f40 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:42.210423 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-057220fb-225b-4eb7-8265-1d9cf5265f40 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1407 microversion: 2.20 time: 0.153500 May 10 21:24:42.211299 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 297/595] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:24:42 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:24:42.527276 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-ff9f8a7e-eaaf-4697-b10a-3cb0d850547e req-b7b7a8a1-9fa1-4727-bb0b-820393a1381b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f31bca91-29e8-4a4c-ba97-7e4c993502ef", "tag": "53eb87d9-7496-49b6-b83d-932f96780089"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:24:42.541880 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-ff9f8a7e-eaaf-4697-b10a-3cb0d850547e req-b7b7a8a1-9fa1-4727-bb0b-820393a1381b service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:42.542743 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-ff9f8a7e-eaaf-4697-b10a-3cb0d850547e req-b7b7a8a1-9fa1-4727-bb0b-820393a1381b service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:42.555645 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-ff9f8a7e-eaaf-4697-b10a-3cb0d850547e req-b7b7a8a1-9fa1-4727-bb0b-820393a1381b service nova] Creating event network-changed:53eb87d9-7496-49b6-b83d-932f96780089 for instance f31bca91-29e8-4a4c-ba97-7e4c993502ef on hv-cinder-83608 May 10 21:24:42.560828 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-ff9f8a7e-eaaf-4697-b10a-3cb0d850547e req-b7b7a8a1-9fa1-4727-bb0b-820393a1381b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038426 May 10 21:24:42.561545 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 299/596] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:24:43.168703 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-cbf9ab87-a7f1-4c1c-abf0-e16eb8f8b338 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:43.169220 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-cbf9ab87-a7f1-4c1c-abf0-e16eb8f8b338 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:43.175523 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-cbf9ab87-a7f1-4c1c-abf0-e16eb8f8b338 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:43.175961 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-cbf9ab87-a7f1-4c1c-abf0-e16eb8f8b338 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:43.176713 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-cbf9ab87-a7f1-4c1c-abf0-e16eb8f8b338 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:43.177138 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-cbf9ab87-a7f1-4c1c-abf0-e16eb8f8b338 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:43.229915 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-31126a70-7065-4c33-a5b1-0d4c48c2b6ef tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:43.231243 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-31126a70-7065-4c33-a5b1-0d4c48c2b6ef tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:43.238152 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-31126a70-7065-4c33-a5b1-0d4c48c2b6ef tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:43.239053 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-31126a70-7065-4c33-a5b1-0d4c48c2b6ef tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:43.240015 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-31126a70-7065-4c33-a5b1-0d4c48c2b6ef tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:43.240608 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-31126a70-7065-4c33-a5b1-0d4c48c2b6ef tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:43.323343 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-cbf9ab87-a7f1-4c1c-abf0-e16eb8f8b338 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:43.332283 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-cbf9ab87-a7f1-4c1c-abf0-e16eb8f8b338 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1756 microversion: 2.1 time: 0.167459 May 10 21:24:43.332994 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 298/597] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:43 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:43.377643 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-31126a70-7065-4c33-a5b1-0d4c48c2b6ef tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:43.386348 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-31126a70-7065-4c33-a5b1-0d4c48c2b6ef tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:43.392604 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-31126a70-7065-4c33-a5b1-0d4c48c2b6ef tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:43.392604 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-31126a70-7065-4c33-a5b1-0d4c48c2b6ef tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1407 microversion: 2.20 time: 0.164120 May 10 21:24:43.392604 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 300/598] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:24:43 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:24:44.349980 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-1b0768bf-8db9-4538-af37-a4df9d3a4269 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:44.351422 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-1b0768bf-8db9-4538-af37-a4df9d3a4269 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:44.357742 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1b0768bf-8db9-4538-af37-a4df9d3a4269 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:44.358187 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1b0768bf-8db9-4538-af37-a4df9d3a4269 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:44.358974 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1b0768bf-8db9-4538-af37-a4df9d3a4269 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:44.359400 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1b0768bf-8db9-4538-af37-a4df9d3a4269 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:44.406799 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-16b20e2e-f95a-4a06-90ca-f7ff947c6807 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:44.407395 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-16b20e2e-f95a-4a06-90ca-f7ff947c6807 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:44.414893 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-16b20e2e-f95a-4a06-90ca-f7ff947c6807 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:44.415659 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-16b20e2e-f95a-4a06-90ca-f7ff947c6807 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:44.416644 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-16b20e2e-f95a-4a06-90ca-f7ff947c6807 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:44.417300 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-16b20e2e-f95a-4a06-90ca-f7ff947c6807 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:44.502650 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-1b0768bf-8db9-4538-af37-a4df9d3a4269 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:44.511466 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-1b0768bf-8db9-4538-af37-a4df9d3a4269 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1756 microversion: 2.1 time: 0.165293 May 10 21:24:44.512048 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 299/599] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:44 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:44.543823 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-16b20e2e-f95a-4a06-90ca-f7ff947c6807 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:44.551612 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-16b20e2e-f95a-4a06-90ca-f7ff947c6807 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:44.553110 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-16b20e2e-f95a-4a06-90ca-f7ff947c6807 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:44.554251 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-16b20e2e-f95a-4a06-90ca-f7ff947c6807 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1407 microversion: 2.20 time: 0.151325 May 10 21:24:44.554839 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 301/600] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:24:44 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:24:45.528974 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-dbb082d7-389c-42b9-bbd1-7627d54256e3 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:45.529580 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-dbb082d7-389c-42b9-bbd1-7627d54256e3 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:45.535974 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-dbb082d7-389c-42b9-bbd1-7627d54256e3 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:45.536417 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-dbb082d7-389c-42b9-bbd1-7627d54256e3 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:45.537175 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-dbb082d7-389c-42b9-bbd1-7627d54256e3 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:45.537608 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-dbb082d7-389c-42b9-bbd1-7627d54256e3 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:45.572702 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-ec4be111-53bf-4079-ac23-e8b91656a00d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:45.573314 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-ec4be111-53bf-4079-ac23-e8b91656a00d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:45.579745 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ec4be111-53bf-4079-ac23-e8b91656a00d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:45.580196 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ec4be111-53bf-4079-ac23-e8b91656a00d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:45.580973 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ec4be111-53bf-4079-ac23-e8b91656a00d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:45.581406 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ec4be111-53bf-4079-ac23-e8b91656a00d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:45.680377 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-dbb082d7-389c-42b9-bbd1-7627d54256e3 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:45.688369 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-dbb082d7-389c-42b9-bbd1-7627d54256e3 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1756 microversion: 2.1 time: 0.163244 May 10 21:24:45.688951 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 300/601] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:45 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:45.714249 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-ec4be111-53bf-4079-ac23-e8b91656a00d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:45.722009 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-ec4be111-53bf-4079-ac23-e8b91656a00d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:45.723623 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-ec4be111-53bf-4079-ac23-e8b91656a00d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:45.724720 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-ec4be111-53bf-4079-ac23-e8b91656a00d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1407 microversion: 2.20 time: 0.156652 May 10 21:24:45.725302 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 302/602] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:24:45 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:24:46.705066 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-df0e163e-4cd1-4304-9bd2-0d159af0609b tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:46.705669 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-df0e163e-4cd1-4304-9bd2-0d159af0609b tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:46.712600 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-df0e163e-4cd1-4304-9bd2-0d159af0609b tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:46.713038 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-df0e163e-4cd1-4304-9bd2-0d159af0609b tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:46.713821 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-df0e163e-4cd1-4304-9bd2-0d159af0609b tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:46.714243 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-df0e163e-4cd1-4304-9bd2-0d159af0609b tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:46.742904 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-18476c52-5b71-48fd-b22c-7fdda9db7987 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:46.743525 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-18476c52-5b71-48fd-b22c-7fdda9db7987 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:46.749848 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-18476c52-5b71-48fd-b22c-7fdda9db7987 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:46.750296 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-18476c52-5b71-48fd-b22c-7fdda9db7987 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:46.751108 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-18476c52-5b71-48fd-b22c-7fdda9db7987 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:46.751544 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-18476c52-5b71-48fd-b22c-7fdda9db7987 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:46.867979 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-df0e163e-4cd1-4304-9bd2-0d159af0609b tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:46.875782 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-df0e163e-4cd1-4304-9bd2-0d159af0609b tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1756 microversion: 2.1 time: 0.174573 May 10 21:24:46.876374 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 301/603] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:46 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:46.883109 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-18476c52-5b71-48fd-b22c-7fdda9db7987 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:46.891169 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-18476c52-5b71-48fd-b22c-7fdda9db7987 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:46.892662 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-18476c52-5b71-48fd-b22c-7fdda9db7987 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:46.893751 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-18476c52-5b71-48fd-b22c-7fdda9db7987 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1407 microversion: 2.20 time: 0.155177 May 10 21:24:46.894380 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 303/604] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:24:46 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:24:47.894076 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-b1b79a1d-c700-4aa0-9dcd-ababef3bd79d tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:47.894700 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-b1b79a1d-c700-4aa0-9dcd-ababef3bd79d tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:47.901537 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b1b79a1d-c700-4aa0-9dcd-ababef3bd79d tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:47.901979 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b1b79a1d-c700-4aa0-9dcd-ababef3bd79d tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:47.902751 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b1b79a1d-c700-4aa0-9dcd-ababef3bd79d tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:47.903198 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b1b79a1d-c700-4aa0-9dcd-ababef3bd79d tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:47.912707 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-529cec4e-16fc-4a93-858a-57b50b8f45e0 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:47.914153 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-529cec4e-16fc-4a93-858a-57b50b8f45e0 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:47.920412 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-529cec4e-16fc-4a93-858a-57b50b8f45e0 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:47.920851 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-529cec4e-16fc-4a93-858a-57b50b8f45e0 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:47.921606 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-529cec4e-16fc-4a93-858a-57b50b8f45e0 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:47.922030 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-529cec4e-16fc-4a93-858a-57b50b8f45e0 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:48.044830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-b1b79a1d-c700-4aa0-9dcd-ababef3bd79d tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:48.053104 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-529cec4e-16fc-4a93-858a-57b50b8f45e0 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:48.053489 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-b1b79a1d-c700-4aa0-9dcd-ababef3bd79d tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1756 microversion: 2.1 time: 0.163151 May 10 21:24:48.054362 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 302/605] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:47 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:48.061369 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-529cec4e-16fc-4a93-858a-57b50b8f45e0 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:48.062892 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-529cec4e-16fc-4a93-858a-57b50b8f45e0 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:48.063988 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-529cec4e-16fc-4a93-858a-57b50b8f45e0 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1407 microversion: 2.20 time: 0.155049 May 10 21:24:48.064547 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 304/606] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:24:47 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:24:49.071224 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-409589b6-6b98-4e65-bbf2-321262d77f4e tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:49.072200 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-409589b6-6b98-4e65-bbf2-321262d77f4e tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:49.078322 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-409589b6-6b98-4e65-bbf2-321262d77f4e tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:49.078878 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-409589b6-6b98-4e65-bbf2-321262d77f4e tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:49.079653 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-409589b6-6b98-4e65-bbf2-321262d77f4e tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:49.080083 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-409589b6-6b98-4e65-bbf2-321262d77f4e tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:49.081091 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-88078a52-39e1-4435-9800-ff0414b373de tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:49.081700 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-88078a52-39e1-4435-9800-ff0414b373de tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:49.089371 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-88078a52-39e1-4435-9800-ff0414b373de tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:49.089827 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-88078a52-39e1-4435-9800-ff0414b373de tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:49.090641 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-88078a52-39e1-4435-9800-ff0414b373de tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:49.091078 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-88078a52-39e1-4435-9800-ff0414b373de tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:49.234961 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-88078a52-39e1-4435-9800-ff0414b373de tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:49.240477 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-409589b6-6b98-4e65-bbf2-321262d77f4e tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:49.249851 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-409589b6-6b98-4e65-bbf2-321262d77f4e tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1759 microversion: 2.1 time: 0.182995 May 10 21:24:49.250466 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 303/607] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:49 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1759 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:24:49.264123 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-88078a52-39e1-4435-9800-ff0414b373de tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:49.265630 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-88078a52-39e1-4435-9800-ff0414b373de tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:49.266794 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-88078a52-39e1-4435-9800-ff0414b373de tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1407 microversion: 2.20 time: 0.189619 May 10 21:24:49.270768 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 305/608] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:24:49 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:24:49.271265 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-d1af49ee-cd04-4c0d-a973-b32a656f8886 req-b2fc87e9-b3fb-4c10-a815-a73bc23ef4c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f31bca91-29e8-4a4c-ba97-7e4c993502ef", "name": "network-vif-plugged", "status": "completed", "tag": "53eb87d9-7496-49b6-b83d-932f96780089"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:24:49.279920 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-d1af49ee-cd04-4c0d-a973-b32a656f8886 req-b2fc87e9-b3fb-4c10-a815-a73bc23ef4c0 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:49.280357 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-d1af49ee-cd04-4c0d-a973-b32a656f8886 req-b2fc87e9-b3fb-4c10-a815-a73bc23ef4c0 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:49.291192 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-d1af49ee-cd04-4c0d-a973-b32a656f8886 req-b2fc87e9-b3fb-4c10-a815-a73bc23ef4c0 service nova] Creating event network-vif-plugged:53eb87d9-7496-49b6-b83d-932f96780089 for instance f31bca91-29e8-4a4c-ba97-7e4c993502ef on hv-cinder-83608 May 10 21:24:49.296114 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-d1af49ee-cd04-4c0d-a973-b32a656f8886 req-b2fc87e9-b3fb-4c10-a815-a73bc23ef4c0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028610 May 10 21:24:49.296704 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 304/609] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:24:50.285481 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a9c07aac-96aa-458e-aad4-7f43de24f0b2 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:50.285998 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-a9c07aac-96aa-458e-aad4-7f43de24f0b2 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:50.292366 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a9c07aac-96aa-458e-aad4-7f43de24f0b2 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:50.292811 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a9c07aac-96aa-458e-aad4-7f43de24f0b2 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:50.293574 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a9c07aac-96aa-458e-aad4-7f43de24f0b2 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:50.294003 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a9c07aac-96aa-458e-aad4-7f43de24f0b2 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:50.429784 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-a9c07aac-96aa-458e-aad4-7f43de24f0b2 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:50.437498 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-a9c07aac-96aa-458e-aad4-7f43de24f0b2 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:50.439034 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-a9c07aac-96aa-458e-aad4-7f43de24f0b2 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:50.440138 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-a9c07aac-96aa-458e-aad4-7f43de24f0b2 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1407 microversion: 2.20 time: 0.158606 May 10 21:24:50.440697 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 306/610] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:24:50 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:24:51.459793 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-e071b5f5-9c76-4641-9311-a1dfb3805032 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:51.460551 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-e071b5f5-9c76-4641-9311-a1dfb3805032 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:51.466629 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e071b5f5-9c76-4641-9311-a1dfb3805032 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:51.467065 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e071b5f5-9c76-4641-9311-a1dfb3805032 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:51.467812 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e071b5f5-9c76-4641-9311-a1dfb3805032 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:51.468236 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e071b5f5-9c76-4641-9311-a1dfb3805032 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:51.601092 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-e071b5f5-9c76-4641-9311-a1dfb3805032 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:51.608897 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-e071b5f5-9c76-4641-9311-a1dfb3805032 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:51.610402 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-e071b5f5-9c76-4641-9311-a1dfb3805032 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:51.611579 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-e071b5f5-9c76-4641-9311-a1dfb3805032 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1599 microversion: 2.20 time: 0.156828 May 10 21:24:51.612156 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 305/611] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:24:51 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:24:51.630125 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-af587706-c78b-4f1a-bd89-4727bfaa7975 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:51.630718 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-af587706-c78b-4f1a-bd89-4727bfaa7975 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:51.637194 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-af587706-c78b-4f1a-bd89-4727bfaa7975 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:51.637629 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-af587706-c78b-4f1a-bd89-4727bfaa7975 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:51.638430 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-af587706-c78b-4f1a-bd89-4727bfaa7975 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:51.638901 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-af587706-c78b-4f1a-bd89-4727bfaa7975 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:51.716356 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-af587706-c78b-4f1a-bd89-4727bfaa7975 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090124 May 10 21:24:51.721338 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 307/612] 10.222.0.25 () {60 vars in 1315 bytes} [Tue May 10 21:24:51 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:24:52.729716 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-5ca85473-8585-4d40-9ab4-a9cd84a9e370 req-f591f249-95e5-4837-a9ed-a8a1f02139b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f31bca91-29e8-4a4c-ba97-7e4c993502ef", "tag": "53eb87d9-7496-49b6-b83d-932f96780089"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:24:52.737914 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-5ca85473-8585-4d40-9ab4-a9cd84a9e370 req-f591f249-95e5-4837-a9ed-a8a1f02139b2 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:52.738349 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-5ca85473-8585-4d40-9ab4-a9cd84a9e370 req-f591f249-95e5-4837-a9ed-a8a1f02139b2 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:52.749685 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-5ca85473-8585-4d40-9ab4-a9cd84a9e370 req-f591f249-95e5-4837-a9ed-a8a1f02139b2 service nova] Creating event network-changed:53eb87d9-7496-49b6-b83d-932f96780089 for instance f31bca91-29e8-4a4c-ba97-7e4c993502ef on hv-cinder-83608 May 10 21:24:52.754470 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-5ca85473-8585-4d40-9ab4-a9cd84a9e370 req-f591f249-95e5-4837-a9ed-a8a1f02139b2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029042 May 10 21:24:52.755544 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 306/613] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:24:59.255971 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-19bbd62c-5f3c-4f62-94d0-abdd9e2c0bc1 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:59.258154 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-19bbd62c-5f3c-4f62-94d0-abdd9e2c0bc1 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:59.264463 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-19bbd62c-5f3c-4f62-94d0-abdd9e2c0bc1 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:59.264907 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-19bbd62c-5f3c-4f62-94d0-abdd9e2c0bc1 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:59.265673 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-19bbd62c-5f3c-4f62-94d0-abdd9e2c0bc1 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:59.266108 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-19bbd62c-5f3c-4f62-94d0-abdd9e2c0bc1 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:59.294548 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-19bbd62c-5f3c-4f62-94d0-abdd9e2c0bc1 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043195 May 10 21:24:59.295099 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 308/614] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 10 21:24:59 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 21:24:59.353598 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-6995e008-d75f-4ee2-9793-8fd492fc0797 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:59.354185 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-6995e008-d75f-4ee2-9793-8fd492fc0797 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:59.360373 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6995e008-d75f-4ee2-9793-8fd492fc0797 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:59.360819 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6995e008-d75f-4ee2-9793-8fd492fc0797 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:59.361581 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6995e008-d75f-4ee2-9793-8fd492fc0797 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:59.362013 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6995e008-d75f-4ee2-9793-8fd492fc0797 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:59.387865 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-6995e008-d75f-4ee2-9793-8fd492fc0797 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Going to try to terminate instance {{(pid=117678) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 21:24:59.557835 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-456d70af-f7ec-4752-a301-0f56f9ac2a71 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:59.558324 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-456d70af-f7ec-4752-a301-0f56f9ac2a71 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:59.564226 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-456d70af-f7ec-4752-a301-0f56f9ac2a71 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:59.564669 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-456d70af-f7ec-4752-a301-0f56f9ac2a71 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:59.565426 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-456d70af-f7ec-4752-a301-0f56f9ac2a71 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:59.565861 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-456d70af-f7ec-4752-a301-0f56f9ac2a71 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:59.646120 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.objects.instance [None req-456d70af-f7ec-4752-a301-0f56f9ac2a71 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lazy-loading 'services' on Instance uuid e6abd4e9-f5fd-4413-9d26-808c47d618ab {{(pid=117679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:24:59.696846 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-6995e008-d75f-4ee2-9793-8fd492fc0797 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 204 len: 0 microversion: 2.1 time: 0.347781 May 10 21:24:59.697448 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 307/615] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 10 21:24:59 2022] DELETE /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 21:24:59.706078 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-7ad82b7e-ebcc-43c4-b832-71adcd5ae180 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:59.706809 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-7ad82b7e-ebcc-43c4-b832-71adcd5ae180 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:59.713445 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7ad82b7e-ebcc-43c4-b832-71adcd5ae180 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:59.713882 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7ad82b7e-ebcc-43c4-b832-71adcd5ae180 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:59.714667 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7ad82b7e-ebcc-43c4-b832-71adcd5ae180 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:59.715090 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7ad82b7e-ebcc-43c4-b832-71adcd5ae180 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:59.850061 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-456d70af-f7ec-4752-a301-0f56f9ac2a71 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab/os-volume_attachments/505c516f-42bc-4978-a113-aee2198b7892" status: 202 len: 0 microversion: 2.1 time: 0.296509 May 10 21:24:59.852790 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-7ad82b7e-ebcc-43c4-b832-71adcd5ae180 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:24:59.852923 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 309/616] 10.222.0.25 () {58 vars in 1415 bytes} [Tue May 10 21:24:59 2022] DELETE /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab/os-volume_attachments/505c516f-42bc-4978-a113-aee2198b7892 => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 21:24:59.860172 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-de531352-3a80-4789-860e-c9c2fc900c2a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:24:59.860369 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-7ad82b7e-ebcc-43c4-b832-71adcd5ae180 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1670 microversion: 2.1 time: 0.158472 May 10 21:24:59.860991 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 308/617] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:24:59 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1670 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:24:59.861435 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-de531352-3a80-4789-860e-c9c2fc900c2a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:24:59.868017 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-de531352-3a80-4789-860e-c9c2fc900c2a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:59.868553 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-de531352-3a80-4789-860e-c9c2fc900c2a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:59.869387 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-de531352-3a80-4789-860e-c9c2fc900c2a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:24:59.869883 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-de531352-3a80-4789-860e-c9c2fc900c2a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:24:59.898966 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-de531352-3a80-4789-860e-c9c2fc900c2a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042980 May 10 21:24:59.899523 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 310/618] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 10 21:24:59 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:25:00.877274 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-8762cbee-1e0e-4b3d-82b7-e5b0175b91ab tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:00.877896 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-8762cbee-1e0e-4b3d-82b7-e5b0175b91ab tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:00.885148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8762cbee-1e0e-4b3d-82b7-e5b0175b91ab tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:00.885582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8762cbee-1e0e-4b3d-82b7-e5b0175b91ab tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:00.886332 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8762cbee-1e0e-4b3d-82b7-e5b0175b91ab tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:00.886777 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8762cbee-1e0e-4b3d-82b7-e5b0175b91ab tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:00.910493 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-3c6f875f-ebda-4e2c-83c1-5fd3aef2158c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:00.911411 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-3c6f875f-ebda-4e2c-83c1-5fd3aef2158c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:00.917918 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3c6f875f-ebda-4e2c-83c1-5fd3aef2158c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:00.918365 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3c6f875f-ebda-4e2c-83c1-5fd3aef2158c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:00.919164 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3c6f875f-ebda-4e2c-83c1-5fd3aef2158c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:00.919596 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3c6f875f-ebda-4e2c-83c1-5fd3aef2158c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:00.950571 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-3c6f875f-ebda-4e2c-83c1-5fd3aef2158c tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044067 May 10 21:25:00.951139 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 311/619] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 10 21:25:00 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:25:01.016946 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-8762cbee-1e0e-4b3d-82b7-e5b0175b91ab tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:01.024298 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-8762cbee-1e0e-4b3d-82b7-e5b0175b91ab tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1670 microversion: 2.1 time: 0.150853 May 10 21:25:01.024867 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 309/620] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:00 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1670 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:01.963310 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e4a02152-8147-4de3-ae22-d617279d2e40 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:01.964320 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-e4a02152-8147-4de3-ae22-d617279d2e40 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:01.970716 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e4a02152-8147-4de3-ae22-d617279d2e40 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:01.971161 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e4a02152-8147-4de3-ae22-d617279d2e40 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:01.971968 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e4a02152-8147-4de3-ae22-d617279d2e40 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:01.972404 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e4a02152-8147-4de3-ae22-d617279d2e40 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:02.001634 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-e4a02152-8147-4de3-ae22-d617279d2e40 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042236 May 10 21:25:02.002183 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 312/621] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 10 21:25:01 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:25:02.041730 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-02ab4800-f2de-4356-a1c3-d83223def442 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:02.042334 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-02ab4800-f2de-4356-a1c3-d83223def442 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:02.048673 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-02ab4800-f2de-4356-a1c3-d83223def442 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:02.049063 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-02ab4800-f2de-4356-a1c3-d83223def442 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:02.049822 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-02ab4800-f2de-4356-a1c3-d83223def442 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:02.050255 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-02ab4800-f2de-4356-a1c3-d83223def442 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:02.175517 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-02ab4800-f2de-4356-a1c3-d83223def442 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:02.183622 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-02ab4800-f2de-4356-a1c3-d83223def442 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1670 microversion: 2.1 time: 0.146474 May 10 21:25:02.184204 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 310/622] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:02 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1670 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:03.013973 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-826b2755-c1a9-4d68-884a-8f02dc225ade tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:03.020296 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-826b2755-c1a9-4d68-884a-8f02dc225ade tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:03.022341 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-826b2755-c1a9-4d68-884a-8f02dc225ade tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:03.023341 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-826b2755-c1a9-4d68-884a-8f02dc225ade tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:03.024257 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-826b2755-c1a9-4d68-884a-8f02dc225ade tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:03.024702 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-826b2755-c1a9-4d68-884a-8f02dc225ade tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:03.054802 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-826b2755-c1a9-4d68-884a-8f02dc225ade tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044495 May 10 21:25:03.055266 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 313/623] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 10 21:25:03 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 21:25:03.127225 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-80dcce4e-781b-4cac-ad96-aebfd8ea745a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:03.127722 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-80dcce4e-781b-4cac-ad96-aebfd8ea745a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:03.134894 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-80dcce4e-781b-4cac-ad96-aebfd8ea745a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:03.135334 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-80dcce4e-781b-4cac-ad96-aebfd8ea745a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:03.136094 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-80dcce4e-781b-4cac-ad96-aebfd8ea745a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:03.136521 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-80dcce4e-781b-4cac-ad96-aebfd8ea745a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:03.160992 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-80dcce4e-781b-4cac-ad96-aebfd8ea745a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Going to try to terminate instance {{(pid=117678) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 21:25:03.201013 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-b0e10f7f-7a53-46aa-87b1-e0931486033e tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:03.201622 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-b0e10f7f-7a53-46aa-87b1-e0931486033e tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:03.209580 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b0e10f7f-7a53-46aa-87b1-e0931486033e tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:03.209580 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b0e10f7f-7a53-46aa-87b1-e0931486033e tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:03.209580 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b0e10f7f-7a53-46aa-87b1-e0931486033e tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:03.209580 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b0e10f7f-7a53-46aa-87b1-e0931486033e tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:03.417001 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-80dcce4e-781b-4cac-ad96-aebfd8ea745a tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 204 len: 0 microversion: 2.1 time: 0.293401 May 10 21:25:03.421623 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 311/624] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 10 21:25:03 2022] DELETE /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 21:25:03.427921 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-3994c8fe-5dfd-4969-9521-ee4b15c347e7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:03.428744 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-3994c8fe-5dfd-4969-9521-ee4b15c347e7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:03.435394 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3994c8fe-5dfd-4969-9521-ee4b15c347e7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:03.436080 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3994c8fe-5dfd-4969-9521-ee4b15c347e7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:03.437071 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3994c8fe-5dfd-4969-9521-ee4b15c347e7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:03.437497 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3994c8fe-5dfd-4969-9521-ee4b15c347e7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:03.510667 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b0e10f7f-7a53-46aa-87b1-e0931486033e tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:03.533097 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-b0e10f7f-7a53-46aa-87b1-e0931486033e tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1603 microversion: 2.1 time: 0.335780 May 10 21:25:03.533685 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 314/625] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:03 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1603 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:03.581277 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-d2f4b39e-4a11-48bb-bb18-d1c17b8d56f4 req-b85fe5e4-d4f9-415a-9bab-2dc7cd2a9865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef13be90-688a-4ebe-8b3c-c8187cf9cd70", "name": "network-vif-deleted", "tag": "f5baed8c-6e2f-4a63-b64c-43aa352836ce"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:25:03.590097 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-3994c8fe-5dfd-4969-9521-ee4b15c347e7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:03.591747 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-d2f4b39e-4a11-48bb-bb18-d1c17b8d56f4 req-b85fe5e4-d4f9-415a-9bab-2dc7cd2a9865 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:03.592186 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-d2f4b39e-4a11-48bb-bb18-d1c17b8d56f4 req-b85fe5e4-d4f9-415a-9bab-2dc7cd2a9865 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:03.597577 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-3994c8fe-5dfd-4969-9521-ee4b15c347e7 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1690 microversion: 2.1 time: 0.174474 May 10 21:25:03.598238 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 312/626] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:03 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1690 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:03.605726 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-d2f4b39e-4a11-48bb-bb18-d1c17b8d56f4 req-b85fe5e4-d4f9-415a-9bab-2dc7cd2a9865 service nova] Creating event network-vif-deleted:f5baed8c-6e2f-4a63-b64c-43aa352836ce for instance ef13be90-688a-4ebe-8b3c-c8187cf9cd70 on hv-cinder-83608 May 10 21:25:03.611026 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-d2f4b39e-4a11-48bb-bb18-d1c17b8d56f4 req-b85fe5e4-d4f9-415a-9bab-2dc7cd2a9865 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033587 May 10 21:25:03.611572 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 315/627] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:25:04.550984 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-7c5c1e13-8af7-4dcc-9ad3-a1f1c8794dc2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:04.551871 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-7c5c1e13-8af7-4dcc-9ad3-a1f1c8794dc2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:04.558851 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7c5c1e13-8af7-4dcc-9ad3-a1f1c8794dc2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:04.559297 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7c5c1e13-8af7-4dcc-9ad3-a1f1c8794dc2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:04.560058 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7c5c1e13-8af7-4dcc-9ad3-a1f1c8794dc2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:04.560486 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7c5c1e13-8af7-4dcc-9ad3-a1f1c8794dc2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:04.615688 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-80cdaa10-20cc-4b68-9565-17d9e3d1a922 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:04.616887 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-80cdaa10-20cc-4b68-9565-17d9e3d1a922 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:04.624306 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-80cdaa10-20cc-4b68-9565-17d9e3d1a922 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:04.624488 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-7c5c1e13-8af7-4dcc-9ad3-a1f1c8794dc2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:04.624745 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-80cdaa10-20cc-4b68-9565-17d9e3d1a922 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:04.625522 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-80cdaa10-20cc-4b68-9565-17d9e3d1a922 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:04.625950 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-80cdaa10-20cc-4b68-9565-17d9e3d1a922 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:04.633615 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-7c5c1e13-8af7-4dcc-9ad3-a1f1c8794dc2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1603 microversion: 2.1 time: 0.086348 May 10 21:25:04.635059 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 313/628] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:04 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1603 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:04.771573 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-80cdaa10-20cc-4b68-9565-17d9e3d1a922 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:04.780069 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-80cdaa10-20cc-4b68-9565-17d9e3d1a922 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1690 microversion: 2.1 time: 0.168919 May 10 21:25:04.780551 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 316/629] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:04 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:05.652327 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-7a555e0d-b26f-4aff-a318-68f4a1494a9e tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:05.652960 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-7a555e0d-b26f-4aff-a318-68f4a1494a9e tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:05.659307 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7a555e0d-b26f-4aff-a318-68f4a1494a9e tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:05.671975 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7a555e0d-b26f-4aff-a318-68f4a1494a9e tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:05.671975 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7a555e0d-b26f-4aff-a318-68f4a1494a9e tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:05.671975 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7a555e0d-b26f-4aff-a318-68f4a1494a9e tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:05.724556 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-7a555e0d-b26f-4aff-a318-68f4a1494a9e tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:05.732053 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-7a555e0d-b26f-4aff-a318-68f4a1494a9e tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1603 microversion: 2.1 time: 0.084210 May 10 21:25:05.732626 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 314/630] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:05 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1603 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:05.797163 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a4a02680-5dec-4903-b215-7961e8732b2e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:05.797813 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-a4a02680-5dec-4903-b215-7961e8732b2e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:05.805160 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a4a02680-5dec-4903-b215-7961e8732b2e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:05.805663 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a4a02680-5dec-4903-b215-7961e8732b2e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:05.806457 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a4a02680-5dec-4903-b215-7961e8732b2e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:05.806887 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a4a02680-5dec-4903-b215-7961e8732b2e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:05.933297 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-a4a02680-5dec-4903-b215-7961e8732b2e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:05.940660 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-a4a02680-5dec-4903-b215-7961e8732b2e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1690 microversion: 2.1 time: 0.147532 May 10 21:25:05.941233 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 317/631] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:05 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1690 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:06.748714 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-4dbd53b9-158c-4596-9547-ab137784f8ea tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:06.749315 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-4dbd53b9-158c-4596-9547-ab137784f8ea tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:06.755601 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4dbd53b9-158c-4596-9547-ab137784f8ea tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:06.756042 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4dbd53b9-158c-4596-9547-ab137784f8ea tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:06.756801 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4dbd53b9-158c-4596-9547-ab137784f8ea tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:06.757840 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4dbd53b9-158c-4596-9547-ab137784f8ea tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:06.820108 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-4dbd53b9-158c-4596-9547-ab137784f8ea tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:06.827340 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-4dbd53b9-158c-4596-9547-ab137784f8ea tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1603 microversion: 2.1 time: 0.082468 May 10 21:25:06.827904 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 315/632] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:06 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1603 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:06.957144 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-245f3448-f92e-4255-a0f7-67be74a0c5ef tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:06.957732 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-245f3448-f92e-4255-a0f7-67be74a0c5ef tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:06.965023 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-245f3448-f92e-4255-a0f7-67be74a0c5ef tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:06.965592 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-245f3448-f92e-4255-a0f7-67be74a0c5ef tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:06.966345 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-245f3448-f92e-4255-a0f7-67be74a0c5ef tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:06.966799 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-245f3448-f92e-4255-a0f7-67be74a0c5ef tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:07.101800 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-245f3448-f92e-4255-a0f7-67be74a0c5ef tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:07.109050 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-245f3448-f92e-4255-a0f7-67be74a0c5ef tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1690 microversion: 2.1 time: 0.155785 May 10 21:25:07.109619 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 318/633] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:06 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:07.848151 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-8583266a-53b4-4f87-b500-c7cf3b234af3 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:07.848151 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-8583266a-53b4-4f87-b500-c7cf3b234af3 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:07.852869 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8583266a-53b4-4f87-b500-c7cf3b234af3 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:07.853560 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8583266a-53b4-4f87-b500-c7cf3b234af3 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:07.854114 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8583266a-53b4-4f87-b500-c7cf3b234af3 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:07.854569 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8583266a-53b4-4f87-b500-c7cf3b234af3 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:07.887799 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8583266a-53b4-4f87-b500-c7cf3b234af3 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:07.888254 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8583266a-53b4-4f87-b500-c7cf3b234af3 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:07.888706 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.objects.instance [None req-8583266a-53b4-4f87-b500-c7cf3b234af3 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lazy-loading 'fault' on Instance uuid ef13be90-688a-4ebe-8b3c-c8187cf9cd70 {{(pid=117678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:25:07.939957 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-8583266a-53b4-4f87-b500-c7cf3b234af3 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:07.946584 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-8583266a-53b4-4f87-b500-c7cf3b234af3 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 200 len: 1326 microversion: 2.1 time: 0.105151 May 10 21:25:07.947173 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 316/634] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:07 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 1326 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:08.126882 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-dc2a696a-5fb9-443e-b223-bb50a9bb20b2 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:08.127515 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-dc2a696a-5fb9-443e-b223-bb50a9bb20b2 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:08.135476 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dc2a696a-5fb9-443e-b223-bb50a9bb20b2 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:08.136480 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dc2a696a-5fb9-443e-b223-bb50a9bb20b2 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:08.136687 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dc2a696a-5fb9-443e-b223-bb50a9bb20b2 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:08.137900 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dc2a696a-5fb9-443e-b223-bb50a9bb20b2 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:08.209984 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-c6f44c08-32f0-4776-ac78-d55346df8a49 req-f0b32928-8bf1-42eb-8b1a-a078a50fb913 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6abd4e9-f5fd-4413-9d26-808c47d618ab", "name": "network-vif-deleted", "tag": "889c7cd8-c299-4d1a-a392-db09b20c9d47"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:25:08.220246 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-c6f44c08-32f0-4776-ac78-d55346df8a49 req-f0b32928-8bf1-42eb-8b1a-a078a50fb913 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:08.229053 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-c6f44c08-32f0-4776-ac78-d55346df8a49 req-f0b32928-8bf1-42eb-8b1a-a078a50fb913 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:08.229329 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-dc2a696a-5fb9-443e-b223-bb50a9bb20b2 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:08.233279 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-c6f44c08-32f0-4776-ac78-d55346df8a49 req-f0b32928-8bf1-42eb-8b1a-a078a50fb913 service nova] Creating event network-vif-deleted:889c7cd8-c299-4d1a-a392-db09b20c9d47 for instance e6abd4e9-f5fd-4413-9d26-808c47d618ab on hv-cinder-83608 May 10 21:25:08.234353 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-dc2a696a-5fb9-443e-b223-bb50a9bb20b2 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 200 len: 1623 microversion: 2.1 time: 0.111559 May 10 21:25:08.242484 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 319/635] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:08 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 1623 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:08.246898 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-c6f44c08-32f0-4776-ac78-d55346df8a49 req-f0b32928-8bf1-42eb-8b1a-a078a50fb913 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040330 May 10 21:25:08.247657 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 317/636] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:25:08.963728 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-264b0c5c-c6af-4def-87ef-4dcd9824437a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:08.964251 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-264b0c5c-c6af-4def-87ef-4dcd9824437a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:08.970630 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-264b0c5c-c6af-4def-87ef-4dcd9824437a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:08.971087 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-264b0c5c-c6af-4def-87ef-4dcd9824437a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:08.971868 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-264b0c5c-c6af-4def-87ef-4dcd9824437a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:08.972304 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-264b0c5c-c6af-4def-87ef-4dcd9824437a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:08.986781 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-264b0c5c-c6af-4def-87ef-4dcd9824437a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] HTTP exception thrown: Instance ef13be90-688a-4ebe-8b3c-c8187cf9cd70 could not be found. May 10 21:25:08.988491 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-264b0c5c-c6af-4def-87ef-4dcd9824437a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Request method failure captured: May 10 21:25:08.988491 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: request: GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 HTTP/1.1 May 10 21:25:08.988491 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept: application/json May 10 21:25:08.988491 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity May 10 21:25:08.988491 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Connection: close May 10 21:25:08.988491 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Length: 0 May 10 21:25:08.988491 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Type: application/json May 10 21:25:08.988491 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Host: 10.222.0.25 May 10 21:25:08.988491 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None May 10 21:25:08.988491 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 May 10 21:25:08.988491 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABietcY-t0vlEI6Xr4dyPWLr9tioOexYfyEUPbYCXYJ4ksyZvxUZVrhXrQRmekb5g_uKcvciv7CkAlQJJ5acYI4TzbPJP7yhM5erNpPxfCWlCHTcn33NeNbOAXEUtggv1a5ReAeyw11PlAI5P5LC6NHPghk894HwWU9mIncs8G43mu8VaA May 10 21:25:08.988491 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Id: None May 10 21:25:08.988491 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Name: None May 10 21:25:08.988491 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed May 10 21:25:08.988491 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True May 10 21:25:08.988491 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default May 10 21:25:08.988491 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default May 10 21:25:08.988491 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Id: 604bb43d90e344d3a89838c6575d12c2 May 10 21:25:08.988491 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-AttachVolumeTestJSON-801563513 May 10 21:25:08.988491 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Role: member,reader May 10 21:25:08.988491 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Roles: member,reader May 10 21:25:08.990129 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/604bb43d90e344d3a89838c6575d12c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_604bb43d90e344d3a89838c6575d12c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/604bb43d90e344d3a89838c6575d12c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/604bb43d90e344d3a89838c6575d12c2"}]}] May 10 21:25:08.990129 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-AttachVolumeTestJSON-801563513 May 10 21:25:08.990129 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Id: 604bb43d90e344d3a89838c6575d12c2 May 10 21:25:08.990129 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-AttachVolumeTestJSON-801563513 May 10 21:25:08.990129 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User: tempest-AttachVolumeTestJSON-801563513-project May 10 21:25:08.990129 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default May 10 21:25:08.990129 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default May 10 21:25:08.990129 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Id: 05eb9dfc751a4b44a8d4d7a03138f0d4 May 10 21:25:08.990129 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-AttachVolumeTestJSON-801563513-project May 10 21:25:08.990129 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: method: > May 10 21:25:08.990129 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: exception: Instance ef13be90-688a-4ebe-8b3c-c8187cf9cd70 could not be found. May 10 21:25:08.990129 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: action_args: {'id': 'ef13be90-688a-4ebe-8b3c-c8187cf9cd70'} May 10 21:25:08.991111 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:25:08.991111 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:08.991111 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:25:08.991111 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:25:08.991111 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:25:08.991111 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:25:08.991111 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:25:08.991111 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:25:08.991111 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:25:08.991111 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:25:08.991111 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef13be90-688a-4ebe-8b3c-c8187cf9cd70 could not be found. May 10 21:25:08.991111 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:25:08.991111 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:25:08.991111 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:25:08.991111 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:08.991111 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:25:08.991111 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:25:08.991111 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:25:08.991111 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:25:08.991111 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:25:08.993323 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:25:08.993323 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:25:08.993323 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:25:08.993323 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:25:08.993323 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:25:08.993323 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:25:08.993323 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:25:08.993323 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef13be90-688a-4ebe-8b3c-c8187cf9cd70 could not be found. May 10 21:25:08.993323 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:25:08.993323 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:25:08.993323 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:25:08.993323 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:08.993323 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:25:08.993323 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:25:08.993323 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:25:08.993323 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:25:08.993323 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef13be90-688a-4ebe-8b3c-c8187cf9cd70 could not be found. May 10 21:25:08.993323 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:25:08.994708 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-264b0c5c-c6af-4def-87ef-4dcd9824437a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Returning 404 to user: Instance ef13be90-688a-4ebe-8b3c-c8187cf9cd70 could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:25:08.994708 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-264b0c5c-c6af-4def-87ef-4dcd9824437a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 404 len: 111 microversion: 2.1 time: 0.030256 May 10 21:25:08.994708 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 320/637] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:08 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 21:25:08.999863 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-724695fb-efe0-42bb-bb31-c8455dca4446 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '.version_select at 0x7f7aea2bfb80>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:09.071595 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-724695fb-efe0-42bb-bb31-c8455dca4446 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-141967161" status: 202 len: 0 microversion: 2.1 time: 0.075794 May 10 21:25:09.082460 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 318/638] 10.222.0.25 () {58 vars in 1217 bytes} [Tue May 10 21:25:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-141967161 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 21:25:09.251312 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-5e049979-7400-4621-bd98-4febfc71ff86 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:09.251905 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-5e049979-7400-4621-bd98-4febfc71ff86 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e6abd4e9-f5fd-4413-9d26-808c47d618ab] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:09.259826 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5e049979-7400-4621-bd98-4febfc71ff86 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:09.260276 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5e049979-7400-4621-bd98-4febfc71ff86 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:09.261040 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5e049979-7400-4621-bd98-4febfc71ff86 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:09.261469 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5e049979-7400-4621-bd98-4febfc71ff86 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:09.276640 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-5e049979-7400-4621-bd98-4febfc71ff86 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] HTTP exception thrown: Instance e6abd4e9-f5fd-4413-9d26-808c47d618ab could not be found. May 10 21:25:09.278191 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-5e049979-7400-4621-bd98-4febfc71ff86 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Request method failure captured: May 10 21:25:09.278191 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: request: GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab HTTP/1.1 May 10 21:25:09.278191 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept: application/json May 10 21:25:09.278191 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity May 10 21:25:09.278191 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Connection: close May 10 21:25:09.278191 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Length: 0 May 10 21:25:09.278191 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Type: application/json May 10 21:25:09.278191 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Host: 10.222.0.25 May 10 21:25:09.278191 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None May 10 21:25:09.278191 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 May 10 21:25:09.278191 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABietceoa2YDFp3vDe6jovGDog94X8BICE9yqvDWgY5jdGYdkHB2lHnE5qpy-JGn-DuIb7JDkx8klyX_PhGtRnUB4IyuUehUiSCq89-lTpBX74SCgCRj4KBQmjjs3BGumQQ03DMZXdd0ZUBAC18LfTUVRuOE-vNOyfC2OTzFN94f1GAdHA May 10 21:25:09.278191 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Id: None May 10 21:25:09.278191 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Name: None May 10 21:25:09.278191 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed May 10 21:25:09.278191 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True May 10 21:25:09.278191 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default May 10 21:25:09.278191 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default May 10 21:25:09.278191 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Id: 78072ca90bf6402b83863597c266a178 May 10 21:25:09.278191 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-845733436 May 10 21:25:09.278191 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Role: member,reader May 10 21:25:09.278191 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Roles: member,reader May 10 21:25:09.279790 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78072ca90bf6402b83863597c266a178"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_78072ca90bf6402b83863597c266a178"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78072ca90bf6402b83863597c266a178"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/78072ca90bf6402b83863597c266a178"}]}] May 10 21:25:09.279790 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-ServerRescueNegativeTestJSON-845733436 May 10 21:25:09.279790 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Id: 78072ca90bf6402b83863597c266a178 May 10 21:25:09.279790 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-845733436 May 10 21:25:09.279790 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User: tempest-ServerRescueNegativeTestJSON-845733436-project May 10 21:25:09.279790 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default May 10 21:25:09.279790 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default May 10 21:25:09.279790 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Id: 02af0eded57547f489be63cd6dc09399 May 10 21:25:09.279790 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-ServerRescueNegativeTestJSON-845733436-project May 10 21:25:09.279790 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: method: > May 10 21:25:09.279790 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: exception: Instance e6abd4e9-f5fd-4413-9d26-808c47d618ab could not be found. May 10 21:25:09.279790 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: action_args: {'id': 'e6abd4e9-f5fd-4413-9d26-808c47d618ab'} May 10 21:25:09.280680 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:25:09.280680 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:09.280680 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:25:09.280680 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:25:09.280680 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:25:09.280680 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:25:09.280680 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:25:09.280680 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:25:09.280680 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:25:09.280680 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:25:09.280680 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6abd4e9-f5fd-4413-9d26-808c47d618ab could not be found. May 10 21:25:09.280680 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:25:09.280680 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:25:09.280680 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:25:09.280680 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:09.280680 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:25:09.280680 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:25:09.280680 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:25:09.280680 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:25:09.280680 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:25:09.282112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:25:09.282112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:25:09.282112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:25:09.282112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:25:09.282112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:25:09.282112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:25:09.282112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:25:09.282112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6abd4e9-f5fd-4413-9d26-808c47d618ab could not be found. May 10 21:25:09.282112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:25:09.282112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:25:09.282112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:25:09.282112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:09.282112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:25:09.282112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:25:09.282112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:25:09.282112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:25:09.282112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6abd4e9-f5fd-4413-9d26-808c47d618ab could not be found. May 10 21:25:09.282112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:25:09.283697 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-5e049979-7400-4621-bd98-4febfc71ff86 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Returning 404 to user: Instance e6abd4e9-f5fd-4413-9d26-808c47d618ab could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:25:09.283697 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-5e049979-7400-4621-bd98-4febfc71ff86 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab" status: 404 len: 111 microversion: 2.1 time: 0.032192 May 10 21:25:09.283697 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 321/639] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:09 2022] GET /compute/v2.1/servers/e6abd4e9-f5fd-4413-9d26-808c47d618ab => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:25:09.288816 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-123ea7fc-5104-4548-b6c8-66e509246e79 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '.version_select at 0x7f7aea276940>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:09.361173 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-123ea7fc-5104-4548-b6c8-66e509246e79 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1203990376" status: 202 len: 0 microversion: 2.1 time: 0.076504 May 10 21:25:09.361920 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 319/640] 10.222.0.25 () {58 vars in 1220 bytes} [Tue May 10 21:25:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1203990376 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 21:25:09.827642 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-b199eb86-dfe9-45c8-a89f-acc742aa0ce0 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Action: 'create', calling method: .version_select at 0x7f7aea403430>, body: {"keypair": {"name": "tempest-keypair-875324762", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwg+NNkbwvuogH74MceWHZdh8pxGykAzrnvW7MxaDNLfrwFPNEpNR+CVUC1Xz1rluFOiP8gFllOL7U9sxybZn++0+ZKPUaW4a5lOyV2R+m0U18UV6KiqjsOzcQOqEy6zA=="}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:25:09.843082 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-b199eb86-dfe9-45c8-a89f-acc742aa0ce0 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Getting quotas for project 604bb43d90e344d3a89838c6575d12c2. Resources: {'key_pairs'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:25:09.848006 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-b199eb86-dfe9-45c8-a89f-acc742aa0ce0 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Getting quotas for user 05eb9dfc751a4b44a8d4d7a03138f0d4 and project 604bb43d90e344d3a89838c6575d12c2. Resources: {'key_pairs'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:25:09.921751 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-b199eb86-dfe9-45c8-a89f-acc742aa0ce0 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.098075 May 10 21:25:09.922363 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 322/641] 10.222.0.25 () {60 vars in 1158 bytes} [Tue May 10 21:25:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:25:12.079580 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-5f7af830-bd71-4cb4-b58f-1a28e82a6fc2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-844854274", "imageRef": "2d72b3e0-7d02-481e-b5e6-17f44e8729d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c8e51741-489e-4b09-8a94-3245895caad6"}], "security_groups": [{"name": "tempest-securitygroup--763550585"}], "key_name": "tempest-keypair-875324762", "user_data": "}} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:25:12.341359 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.network.neutron [None req-5f7af830-bd71-4cb4-b58f-1a28e82a6fc2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] validate_networks() for [('c8e51741-489e-4b09-8a94-3245895caad6', None, None, None, None, None)] {{(pid=117678) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 21:25:12.661729 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-5f95f1f5-095e-4466-8982-c2e5d91270e4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:12.662292 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-5f95f1f5-095e-4466-8982-c2e5d91270e4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:12.670095 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5f95f1f5-095e-4466-8982-c2e5d91270e4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:12.670579 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5f95f1f5-095e-4466-8982-c2e5d91270e4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:12.671360 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5f95f1f5-095e-4466-8982-c2e5d91270e4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:12.671789 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5f95f1f5-095e-4466-8982-c2e5d91270e4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:12.700449 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-5f95f1f5-095e-4466-8982-c2e5d91270e4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Going to try to terminate instance {{(pid=117679) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 21:25:12.931225 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-5f7af830-bd71-4cb4-b58f-1a28e82a6fc2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Flavor limits 0:0:0 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 21:25:12.931676 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-5f7af830-bd71-4cb4-b58f-1a28e82a6fc2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Image limits 0:0:0 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 21:25:12.932155 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-5f7af830-bd71-4cb4-b58f-1a28e82a6fc2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Flavor pref 0:0:0 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 21:25:12.932563 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-5f7af830-bd71-4cb4-b58f-1a28e82a6fc2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Image pref 0:0:0 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 21:25:12.932970 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-5f7af830-bd71-4cb4-b58f-1a28e82a6fc2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 21:25:12.941486 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5f7af830-bd71-4cb4-b58f-1a28e82a6fc2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:12.941930 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5f7af830-bd71-4cb4-b58f-1a28e82a6fc2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:12.942772 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5f7af830-bd71-4cb4-b58f-1a28e82a6fc2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:12.943203 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5f7af830-bd71-4cb4-b58f-1a28e82a6fc2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:12.961377 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.quota [None req-5f7af830-bd71-4cb4-b58f-1a28e82a6fc2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Getting quotas for project 604bb43d90e344d3a89838c6575d12c2. Resources: {'cores', 'instances', 'ram'} {{(pid=117678) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:25:12.965268 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.quota [None req-5f7af830-bd71-4cb4-b58f-1a28e82a6fc2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Getting quotas for user 05eb9dfc751a4b44a8d4d7a03138f0d4 and project 604bb43d90e344d3a89838c6575d12c2. Resources: {'cores', 'instances', 'ram'} {{(pid=117678) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:25:12.975852 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-5f7af830-bd71-4cb4-b58f-1a28e82a6fc2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Going to run 1 instances... {{(pid=117678) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 21:25:12.979241 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-5f7af830-bd71-4cb4-b58f-1a28e82a6fc2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: 5141f323-2d73-494e-a167-49a618d1f67a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d72b3e0-7d02-481e-b5e6-17f44e8729d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 21:25:13.051332 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-5f95f1f5-095e-4466-8982-c2e5d91270e4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 204 len: 0 microversion: 2.1 time: 0.393795 May 10 21:25:13.052037 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 323/642] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 10 21:25:12 2022] DELETE /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 21:25:13.060986 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-aa73889f-361a-48f1-9641-5b4867d7b536 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:13.061675 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-aa73889f-361a-48f1-9641-5b4867d7b536 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:13.067515 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-aa73889f-361a-48f1-9641-5b4867d7b536 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:13.067958 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-aa73889f-361a-48f1-9641-5b4867d7b536 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:13.068718 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-aa73889f-361a-48f1-9641-5b4867d7b536 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:13.069147 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-aa73889f-361a-48f1-9641-5b4867d7b536 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:13.093408 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-5f7af830-bd71-4cb4-b58f-1a28e82a6fc2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.018061 May 10 21:25:13.094375 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 320/643] 10.222.0.25 () {60 vars in 1146 bytes} [Tue May 10 21:25:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 1020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 21:25:13.104724 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-648142f6-ab23-43ba-8daf-00efd4f7f9f2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:13.105440 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-648142f6-ab23-43ba-8daf-00efd4f7f9f2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: 5141f323-2d73-494e-a167-49a618d1f67a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:13.159279 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-648142f6-ab23-43ba-8daf-00efd4f7f9f2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:13.168064 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-648142f6-ab23-43ba-8daf-00efd4f7f9f2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a" status: 200 len: 1236 microversion: 2.1 time: 0.067601 May 10 21:25:13.168857 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 321/644] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:13 2022] GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a => generated 1236 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:13.268488 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-aa73889f-361a-48f1-9641-5b4867d7b536 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:13.276538 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-aa73889f-361a-48f1-9641-5b4867d7b536 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1508 microversion: 2.1 time: 0.219469 May 10 21:25:13.277103 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 324/645] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:13 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1508 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:25:14.185323 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-15b8786b-e117-4eb5-990b-0d892123fd7d tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:14.185936 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-15b8786b-e117-4eb5-990b-0d892123fd7d tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: 5141f323-2d73-494e-a167-49a618d1f67a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:14.192574 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-15b8786b-e117-4eb5-990b-0d892123fd7d tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:14.193030 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-15b8786b-e117-4eb5-990b-0d892123fd7d tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:14.193794 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-15b8786b-e117-4eb5-990b-0d892123fd7d tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:14.194229 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-15b8786b-e117-4eb5-990b-0d892123fd7d tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:14.256479 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-15b8786b-e117-4eb5-990b-0d892123fd7d tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:14.264221 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-15b8786b-e117-4eb5-990b-0d892123fd7d tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a" status: 200 len: 1240 microversion: 2.1 time: 0.082789 May 10 21:25:14.267525 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 322/646] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:14 2022] GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:14.293523 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-2672b1ba-c7b5-4045-979f-3a7649c62f1e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:14.294133 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-2672b1ba-c7b5-4045-979f-3a7649c62f1e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:14.300508 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2672b1ba-c7b5-4045-979f-3a7649c62f1e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:14.300955 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2672b1ba-c7b5-4045-979f-3a7649c62f1e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:14.301935 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2672b1ba-c7b5-4045-979f-3a7649c62f1e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:14.302138 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2672b1ba-c7b5-4045-979f-3a7649c62f1e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:14.425805 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2672b1ba-c7b5-4045-979f-3a7649c62f1e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:14.433356 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-2672b1ba-c7b5-4045-979f-3a7649c62f1e tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1508 microversion: 2.1 time: 0.143682 May 10 21:25:14.433927 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 325/647] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:14 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1508 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:15.281852 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-901cad69-5211-4b8d-90f1-850ec45c15df tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:15.282570 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-901cad69-5211-4b8d-90f1-850ec45c15df tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: 5141f323-2d73-494e-a167-49a618d1f67a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:15.289550 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-901cad69-5211-4b8d-90f1-850ec45c15df tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:15.290000 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-901cad69-5211-4b8d-90f1-850ec45c15df tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:15.290801 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-901cad69-5211-4b8d-90f1-850ec45c15df tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:15.291235 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-901cad69-5211-4b8d-90f1-850ec45c15df tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:15.356213 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-901cad69-5211-4b8d-90f1-850ec45c15df tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:15.363796 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-901cad69-5211-4b8d-90f1-850ec45c15df tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a" status: 200 len: 1240 microversion: 2.1 time: 0.085972 May 10 21:25:15.364358 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 323/648] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:15 2022] GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:15.450258 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-313e7526-2461-4a9f-a411-6aca99ee47d6 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:15.450894 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-313e7526-2461-4a9f-a411-6aca99ee47d6 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:15.457267 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-313e7526-2461-4a9f-a411-6aca99ee47d6 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:15.457715 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-313e7526-2461-4a9f-a411-6aca99ee47d6 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:15.458500 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-313e7526-2461-4a9f-a411-6aca99ee47d6 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:15.458929 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-313e7526-2461-4a9f-a411-6aca99ee47d6 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:15.592591 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-313e7526-2461-4a9f-a411-6aca99ee47d6 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:15.599847 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-313e7526-2461-4a9f-a411-6aca99ee47d6 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1508 microversion: 2.1 time: 0.153409 May 10 21:25:15.600419 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 326/649] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:15 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:25:16.321572 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-effb7f85-eaa5-4469-97f7-ab6835ced1ab req-db3c253d-9304-4bc4-88e6-5b8e49f7c25c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4485a817-baec-4edc-b5d8-757046ba5fa0", "name": "network-vif-deleted", "tag": "328358cc-4c62-4aab-b5d9-f04bb22e58f1"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:25:16.329550 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-effb7f85-eaa5-4469-97f7-ab6835ced1ab req-db3c253d-9304-4bc4-88e6-5b8e49f7c25c service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:16.329993 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-effb7f85-eaa5-4469-97f7-ab6835ced1ab req-db3c253d-9304-4bc4-88e6-5b8e49f7c25c service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:16.342078 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-effb7f85-eaa5-4469-97f7-ab6835ced1ab req-db3c253d-9304-4bc4-88e6-5b8e49f7c25c service nova] Creating event network-vif-deleted:328358cc-4c62-4aab-b5d9-f04bb22e58f1 for instance 4485a817-baec-4edc-b5d8-757046ba5fa0 on hv-cinder-83608 May 10 21:25:16.347008 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-effb7f85-eaa5-4469-97f7-ab6835ced1ab req-db3c253d-9304-4bc4-88e6-5b8e49f7c25c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030055 May 10 21:25:16.347601 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 324/650] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:25:16.380999 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-5b28290b-68a7-45fc-8eb0-27559f903426 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:16.381646 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-5b28290b-68a7-45fc-8eb0-27559f903426 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: 5141f323-2d73-494e-a167-49a618d1f67a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:16.389172 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5b28290b-68a7-45fc-8eb0-27559f903426 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:16.389612 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5b28290b-68a7-45fc-8eb0-27559f903426 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:16.390397 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5b28290b-68a7-45fc-8eb0-27559f903426 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:16.390860 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5b28290b-68a7-45fc-8eb0-27559f903426 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:16.461468 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-5b28290b-68a7-45fc-8eb0-27559f903426 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:16.469243 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-5b28290b-68a7-45fc-8eb0-27559f903426 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a" status: 200 len: 1296 microversion: 2.1 time: 0.092459 May 10 21:25:16.469922 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 327/651] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:16 2022] GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a => generated 1296 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:16.617821 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-b7545cbc-f6b7-4f17-a645-b01969ca4eeb tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:16.618551 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-b7545cbc-f6b7-4f17-a645-b01969ca4eeb tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:16.624708 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b7545cbc-f6b7-4f17-a645-b01969ca4eeb tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:16.625166 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b7545cbc-f6b7-4f17-a645-b01969ca4eeb tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:16.625945 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b7545cbc-f6b7-4f17-a645-b01969ca4eeb tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:16.626420 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b7545cbc-f6b7-4f17-a645-b01969ca4eeb tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:16.659669 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b7545cbc-f6b7-4f17-a645-b01969ca4eeb tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:16.660420 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b7545cbc-f6b7-4f17-a645-b01969ca4eeb tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:16.661040 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.objects.instance [None req-b7545cbc-f6b7-4f17-a645-b01969ca4eeb tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lazy-loading 'fault' on Instance uuid 4485a817-baec-4edc-b5d8-757046ba5fa0 {{(pid=117678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:25:16.706642 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-b7545cbc-f6b7-4f17-a645-b01969ca4eeb tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:16.716047 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-b7545cbc-f6b7-4f17-a645-b01969ca4eeb tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 200 len: 1311 microversion: 2.1 time: 0.102946 May 10 21:25:16.716643 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 325/652] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:16 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 1311 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:17.487223 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4a60f1b1-3a4c-4f35-81f6-519126c48fa6 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:17.487790 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-4a60f1b1-3a4c-4f35-81f6-519126c48fa6 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: 5141f323-2d73-494e-a167-49a618d1f67a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:17.494791 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4a60f1b1-3a4c-4f35-81f6-519126c48fa6 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:17.501075 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4a60f1b1-3a4c-4f35-81f6-519126c48fa6 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:17.501075 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4a60f1b1-3a4c-4f35-81f6-519126c48fa6 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:17.501075 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4a60f1b1-3a4c-4f35-81f6-519126c48fa6 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:17.737813 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-4a60f1b1-3a4c-4f35-81f6-519126c48fa6 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:17.739313 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-4461f2ec-3237-4a8a-a45c-f2d0e99563f3 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:17.740131 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-4461f2ec-3237-4a8a-a45c-f2d0e99563f3 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: 4485a817-baec-4edc-b5d8-757046ba5fa0] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:17.746500 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4a60f1b1-3a4c-4f35-81f6-519126c48fa6 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a" status: 200 len: 1361 microversion: 2.1 time: 0.263413 May 10 21:25:17.747084 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 328/653] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:17 2022] GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a => generated 1361 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:17.747450 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4461f2ec-3237-4a8a-a45c-f2d0e99563f3 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:17.747973 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4461f2ec-3237-4a8a-a45c-f2d0e99563f3 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:17.748748 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4461f2ec-3237-4a8a-a45c-f2d0e99563f3 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:17.749178 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4461f2ec-3237-4a8a-a45c-f2d0e99563f3 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:17.763398 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.wsgi [None req-4461f2ec-3237-4a8a-a45c-f2d0e99563f3 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] HTTP exception thrown: Instance 4485a817-baec-4edc-b5d8-757046ba5fa0 could not be found. May 10 21:25:17.765065 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-4461f2ec-3237-4a8a-a45c-f2d0e99563f3 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Request method failure captured: May 10 21:25:17.765065 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: request: GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 HTTP/1.1 May 10 21:25:17.765065 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept: application/json May 10 21:25:17.765065 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept-Encoding: identity May 10 21:25:17.765065 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Connection: close May 10 21:25:17.765065 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Length: 0 May 10 21:25:17.765065 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Type: application/json May 10 21:25:17.765065 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Host: 10.222.0.25 May 10 21:25:17.765065 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Openstack-System-Scope: None May 10 21:25:17.765065 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: User-Agent: python-urllib3/1.26.9 May 10 21:25:17.765065 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Auth-Token: gAAAAABietceoa2YDFp3vDe6jovGDog94X8BICE9yqvDWgY5jdGYdkHB2lHnE5qpy-JGn-DuIb7JDkx8klyX_PhGtRnUB4IyuUehUiSCq89-lTpBX74SCgCRj4KBQmjjs3BGumQQ03DMZXdd0ZUBAC18LfTUVRuOE-vNOyfC2OTzFN94f1GAdHA May 10 21:25:17.765065 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Id: None May 10 21:25:17.765065 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Name: None May 10 21:25:17.765065 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Identity-Status: Confirmed May 10 21:25:17.765065 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Is-Admin-Project: True May 10 21:25:17.765065 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Id: default May 10 21:25:17.765065 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Name: Default May 10 21:25:17.765065 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Id: 78072ca90bf6402b83863597c266a178 May 10 21:25:17.765065 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-845733436 May 10 21:25:17.765065 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Role: member,reader May 10 21:25:17.765065 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Roles: member,reader May 10 21:25:17.766627 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78072ca90bf6402b83863597c266a178"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_78072ca90bf6402b83863597c266a178"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78072ca90bf6402b83863597c266a178"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/78072ca90bf6402b83863597c266a178"}]}] May 10 21:25:17.766627 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant: tempest-ServerRescueNegativeTestJSON-845733436 May 10 21:25:17.766627 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Id: 78072ca90bf6402b83863597c266a178 May 10 21:25:17.766627 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-845733436 May 10 21:25:17.766627 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User: tempest-ServerRescueNegativeTestJSON-845733436-project May 10 21:25:17.766627 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Id: default May 10 21:25:17.766627 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Name: Default May 10 21:25:17.766627 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Id: 02af0eded57547f489be63cd6dc09399 May 10 21:25:17.766627 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Name: tempest-ServerRescueNegativeTestJSON-845733436-project May 10 21:25:17.766627 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: method: > May 10 21:25:17.766627 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: exception: Instance 4485a817-baec-4edc-b5d8-757046ba5fa0 could not be found. May 10 21:25:17.766627 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: action_args: {'id': '4485a817-baec-4edc-b5d8-757046ba5fa0'} May 10 21:25:17.767403 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:25:17.767403 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:17.767403 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:25:17.767403 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:25:17.767403 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:25:17.767403 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:25:17.767403 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:25:17.767403 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:25:17.767403 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:25:17.767403 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:25:17.767403 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4485a817-baec-4edc-b5d8-757046ba5fa0 could not be found. May 10 21:25:17.767403 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:25:17.767403 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:25:17.767403 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:25:17.767403 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:17.767403 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:25:17.767403 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:25:17.767403 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:25:17.767403 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:25:17.767403 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:25:17.768593 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:25:17.768593 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:25:17.768593 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:25:17.768593 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:25:17.768593 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:25:17.768593 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:25:17.768593 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:25:17.768593 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4485a817-baec-4edc-b5d8-757046ba5fa0 could not be found. May 10 21:25:17.768593 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:25:17.768593 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:25:17.768593 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:25:17.768593 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:17.768593 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:25:17.768593 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:25:17.768593 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:25:17.768593 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:25:17.768593 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4485a817-baec-4edc-b5d8-757046ba5fa0 could not be found. May 10 21:25:17.768593 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:25:17.769608 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-4461f2ec-3237-4a8a-a45c-f2d0e99563f3 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Returning 404 to user: Instance 4485a817-baec-4edc-b5d8-757046ba5fa0 could not be found. {{(pid=117678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:25:17.769608 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-4461f2ec-3237-4a8a-a45c-f2d0e99563f3 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0" status: 404 len: 111 microversion: 2.1 time: 0.031111 May 10 21:25:17.769608 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 326/654] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:17 2022] GET /compute/v2.1/servers/4485a817-baec-4edc-b5d8-757046ba5fa0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 21:25:17.775267 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-00a3f3c2-7f36-449a-ba58-dfb915f640c2 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:17.775759 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-00a3f3c2-7f36-449a-ba58-dfb915f640c2 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:17.781545 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-00a3f3c2-7f36-449a-ba58-dfb915f640c2 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:17.781982 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-00a3f3c2-7f36-449a-ba58-dfb915f640c2 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:17.782763 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-00a3f3c2-7f36-449a-ba58-dfb915f640c2 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:17.783186 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-00a3f3c2-7f36-449a-ba58-dfb915f640c2 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:17.811686 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-00a3f3c2-7f36-449a-ba58-dfb915f640c2 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Going to try to terminate instance {{(pid=117679) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 21:25:18.052026 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-00a3f3c2-7f36-449a-ba58-dfb915f640c2 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad" status: 204 len: 0 microversion: 2.1 time: 0.280274 May 10 21:25:18.052631 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 329/655] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 10 21:25:17 2022] DELETE /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 21:25:18.063919 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-dc2d290c-6137-4f1c-ba0c-f15a8aaee2c1 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:18.065676 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-dc2d290c-6137-4f1c-ba0c-f15a8aaee2c1 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:18.074344 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-dc2d290c-6137-4f1c-ba0c-f15a8aaee2c1 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:18.075073 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-dc2d290c-6137-4f1c-ba0c-f15a8aaee2c1 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:18.076128 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-dc2d290c-6137-4f1c-ba0c-f15a8aaee2c1 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:18.076630 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-dc2d290c-6137-4f1c-ba0c-f15a8aaee2c1 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:18.214685 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-dc2d290c-6137-4f1c-ba0c-f15a8aaee2c1 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:18.223449 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-dc2d290c-6137-4f1c-ba0c-f15a8aaee2c1 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad" status: 200 len: 1522 microversion: 2.1 time: 0.165910 May 10 21:25:18.224395 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 327/656] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:18 2022] GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:18.361173 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-0a4fc8f3-5a5a-49e2-b52d-470e2110a357 req-10e8d027-6b95-43fd-b8d3-4574e5e6ab2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5141f323-2d73-494e-a167-49a618d1f67a", "tag": "04a8540b-67b6-4a39-b9c9-65408369b364"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:25:18.369352 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-0a4fc8f3-5a5a-49e2-b52d-470e2110a357 req-10e8d027-6b95-43fd-b8d3-4574e5e6ab2b service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:18.369789 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-0a4fc8f3-5a5a-49e2-b52d-470e2110a357 req-10e8d027-6b95-43fd-b8d3-4574e5e6ab2b service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:18.380176 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-0a4fc8f3-5a5a-49e2-b52d-470e2110a357 req-10e8d027-6b95-43fd-b8d3-4574e5e6ab2b service nova] Creating event network-changed:04a8540b-67b6-4a39-b9c9-65408369b364 for instance 5141f323-2d73-494e-a167-49a618d1f67a on hv-cinder-83608 May 10 21:25:18.385519 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-0a4fc8f3-5a5a-49e2-b52d-470e2110a357 req-10e8d027-6b95-43fd-b8d3-4574e5e6ab2b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028267 May 10 21:25:18.386083 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 330/657] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:25:18.766813 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-42e9276d-d526-4ccd-aa7e-8c3a6ce80d67 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:18.767414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-42e9276d-d526-4ccd-aa7e-8c3a6ce80d67 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: 5141f323-2d73-494e-a167-49a618d1f67a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:18.773372 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-42e9276d-d526-4ccd-aa7e-8c3a6ce80d67 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:18.773810 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-42e9276d-d526-4ccd-aa7e-8c3a6ce80d67 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:18.774704 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-42e9276d-d526-4ccd-aa7e-8c3a6ce80d67 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:18.775137 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-42e9276d-d526-4ccd-aa7e-8c3a6ce80d67 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:18.903994 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-42e9276d-d526-4ccd-aa7e-8c3a6ce80d67 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:18.911275 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-42e9276d-d526-4ccd-aa7e-8c3a6ce80d67 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a" status: 200 len: 1361 microversion: 2.1 time: 0.148486 May 10 21:25:18.911848 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 328/658] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:18 2022] GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:19.243019 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-1ee4a427-7375-48ad-a2a4-059fd3beacae tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:19.243721 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-1ee4a427-7375-48ad-a2a4-059fd3beacae tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:19.249830 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1ee4a427-7375-48ad-a2a4-059fd3beacae tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:19.250278 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1ee4a427-7375-48ad-a2a4-059fd3beacae tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:19.251080 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1ee4a427-7375-48ad-a2a4-059fd3beacae tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:19.251517 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1ee4a427-7375-48ad-a2a4-059fd3beacae tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:19.382545 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1ee4a427-7375-48ad-a2a4-059fd3beacae tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:19.390012 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-1ee4a427-7375-48ad-a2a4-059fd3beacae tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad" status: 200 len: 1522 microversion: 2.1 time: 0.152563 May 10 21:25:19.390607 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 331/659] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:19 2022] GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:19.926941 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-50f3f6c0-ad43-49bb-a79a-b453f7345c4f tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:19.927541 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-50f3f6c0-ad43-49bb-a79a-b453f7345c4f tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: 5141f323-2d73-494e-a167-49a618d1f67a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:19.933995 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-50f3f6c0-ad43-49bb-a79a-b453f7345c4f tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:19.934430 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-50f3f6c0-ad43-49bb-a79a-b453f7345c4f tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:19.935220 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-50f3f6c0-ad43-49bb-a79a-b453f7345c4f tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:19.935646 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-50f3f6c0-ad43-49bb-a79a-b453f7345c4f tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:20.059686 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-50f3f6c0-ad43-49bb-a79a-b453f7345c4f tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:20.066870 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-50f3f6c0-ad43-49bb-a79a-b453f7345c4f tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a" status: 200 len: 1361 microversion: 2.1 time: 0.143706 May 10 21:25:20.067437 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 329/660] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:19 2022] GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a => generated 1361 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:20.408072 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-b6f54110-8d1c-46ed-a896-d27fe9b534db tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:20.408661 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-b6f54110-8d1c-46ed-a896-d27fe9b534db tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:20.415526 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b6f54110-8d1c-46ed-a896-d27fe9b534db tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:20.415968 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b6f54110-8d1c-46ed-a896-d27fe9b534db tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:20.416727 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b6f54110-8d1c-46ed-a896-d27fe9b534db tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:20.417157 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b6f54110-8d1c-46ed-a896-d27fe9b534db tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:20.543415 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b6f54110-8d1c-46ed-a896-d27fe9b534db tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:20.550606 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-b6f54110-8d1c-46ed-a896-d27fe9b534db tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad" status: 200 len: 1522 microversion: 2.1 time: 0.146365 May 10 21:25:20.551179 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 332/661] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:20 2022] GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:21.084752 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-0303c1a9-9987-4e6f-b8d5-27e79ca800ac tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:21.085275 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-0303c1a9-9987-4e6f-b8d5-27e79ca800ac tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: 5141f323-2d73-494e-a167-49a618d1f67a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:21.092413 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0303c1a9-9987-4e6f-b8d5-27e79ca800ac tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:21.092859 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0303c1a9-9987-4e6f-b8d5-27e79ca800ac tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:21.093655 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0303c1a9-9987-4e6f-b8d5-27e79ca800ac tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:21.094112 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0303c1a9-9987-4e6f-b8d5-27e79ca800ac tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:21.227714 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-0303c1a9-9987-4e6f-b8d5-27e79ca800ac tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:21.234899 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-0303c1a9-9987-4e6f-b8d5-27e79ca800ac tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a" status: 200 len: 1361 microversion: 2.1 time: 0.154127 May 10 21:25:21.235465 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 330/662] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:21 2022] GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:21.296765 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-7ad4ca4d-74ac-4708-b58b-1f7e6cd0f34e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:21.297262 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-7ad4ca4d-74ac-4708-b58b-1f7e6cd0f34e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 11411cb5-9de1-4ea1-8cdf-e770019076dc] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:21.303164 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7ad4ca4d-74ac-4708-b58b-1f7e6cd0f34e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:21.303606 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7ad4ca4d-74ac-4708-b58b-1f7e6cd0f34e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:21.304559 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7ad4ca4d-74ac-4708-b58b-1f7e6cd0f34e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:21.306346 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7ad4ca4d-74ac-4708-b58b-1f7e6cd0f34e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:21.330869 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-7ad4ca4d-74ac-4708-b58b-1f7e6cd0f34e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc/ips" status: 200 len: 151 microversion: 2.1 time: 0.037878 May 10 21:25:21.335096 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 333/663] 10.222.0.25 () {58 vars in 1247 bytes} [Tue May 10 21:25:21 2022] GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:25:21.567804 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-1e5a2d09-99e2-47ee-b8f2-126a2adb1a23 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:21.568409 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-1e5a2d09-99e2-47ee-b8f2-126a2adb1a23 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:21.575002 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1e5a2d09-99e2-47ee-b8f2-126a2adb1a23 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:21.575444 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1e5a2d09-99e2-47ee-b8f2-126a2adb1a23 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:21.576204 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1e5a2d09-99e2-47ee-b8f2-126a2adb1a23 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:21.576630 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1e5a2d09-99e2-47ee-b8f2-126a2adb1a23 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:21.711332 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-1e5a2d09-99e2-47ee-b8f2-126a2adb1a23 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:21.718938 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-1e5a2d09-99e2-47ee-b8f2-126a2adb1a23 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad" status: 200 len: 1522 microversion: 2.1 time: 0.154916 May 10 21:25:21.719508 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 331/664] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:21 2022] GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:22.251913 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a7db55f2-438b-45a1-bc2b-e989632ab97a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:22.252525 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-a7db55f2-438b-45a1-bc2b-e989632ab97a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: 5141f323-2d73-494e-a167-49a618d1f67a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:22.260054 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a7db55f2-438b-45a1-bc2b-e989632ab97a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:22.260492 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a7db55f2-438b-45a1-bc2b-e989632ab97a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:22.261260 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a7db55f2-438b-45a1-bc2b-e989632ab97a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:22.261688 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a7db55f2-438b-45a1-bc2b-e989632ab97a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:22.569707 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-a7db55f2-438b-45a1-bc2b-e989632ab97a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:22.577469 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-a7db55f2-438b-45a1-bc2b-e989632ab97a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a" status: 200 len: 1361 microversion: 2.1 time: 0.329384 May 10 21:25:22.578052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 334/665] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:22 2022] GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a => generated 1361 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:22.736272 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-4d0a67f3-1e54-42ce-aa69-4fbcedd37ac4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:22.736882 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-4d0a67f3-1e54-42ce-aa69-4fbcedd37ac4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:22.744774 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4d0a67f3-1e54-42ce-aa69-4fbcedd37ac4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:22.745228 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4d0a67f3-1e54-42ce-aa69-4fbcedd37ac4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:22.746000 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4d0a67f3-1e54-42ce-aa69-4fbcedd37ac4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:22.746459 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4d0a67f3-1e54-42ce-aa69-4fbcedd37ac4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:22.902323 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-4d0a67f3-1e54-42ce-aa69-4fbcedd37ac4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:22.909961 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-7612978c-0883-4d38-b3b0-8469eebcf74c req-442fb789-1304-4f01-a7cc-6fc209d9f05e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ec9c2a-8806-4da8-9072-ca136cfa83ad", "name": "network-vif-deleted", "tag": "5408ed5b-410e-4f80-8588-0d5ecd304dea"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:25:22.910132 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-4d0a67f3-1e54-42ce-aa69-4fbcedd37ac4 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad" status: 200 len: 1522 microversion: 2.1 time: 0.177647 May 10 21:25:22.918307 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 332/666] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:22 2022] GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:22.920891 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-7612978c-0883-4d38-b3b0-8469eebcf74c req-442fb789-1304-4f01-a7cc-6fc209d9f05e service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:22.921361 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-7612978c-0883-4d38-b3b0-8469eebcf74c req-442fb789-1304-4f01-a7cc-6fc209d9f05e service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:22.932682 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-7612978c-0883-4d38-b3b0-8469eebcf74c req-442fb789-1304-4f01-a7cc-6fc209d9f05e service nova] Creating event network-vif-deleted:5408ed5b-410e-4f80-8588-0d5ecd304dea for instance e4ec9c2a-8806-4da8-9072-ca136cfa83ad on hv-cinder-83608 May 10 21:25:22.933619 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-41babb2b-db4e-44bb-8917-0e09a5441c39 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ddb12a4-5f09-40c0-b7a3-10062218b14e"}} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:25:22.934760 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-41babb2b-db4e-44bb-8917-0e09a5441c39 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 11411cb5-9de1-4ea1-8cdf-e770019076dc] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:22.937475 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-7612978c-0883-4d38-b3b0-8469eebcf74c req-442fb789-1304-4f01-a7cc-6fc209d9f05e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031429 May 10 21:25:22.938058 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 335/667] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:25:22.941626 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-41babb2b-db4e-44bb-8917-0e09a5441c39 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:22.942077 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-41babb2b-db4e-44bb-8917-0e09a5441c39 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:22.942876 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-41babb2b-db4e-44bb-8917-0e09a5441c39 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:22.943309 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-41babb2b-db4e-44bb-8917-0e09a5441c39 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:23.595993 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-812bd186-ae96-4701-95b9-dda1d130f3cd tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:23.596689 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-812bd186-ae96-4701-95b9-dda1d130f3cd tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: 5141f323-2d73-494e-a167-49a618d1f67a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:23.603539 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-812bd186-ae96-4701-95b9-dda1d130f3cd tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:23.603989 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-812bd186-ae96-4701-95b9-dda1d130f3cd tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:23.604748 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-812bd186-ae96-4701-95b9-dda1d130f3cd tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:23.605180 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-812bd186-ae96-4701-95b9-dda1d130f3cd tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:23.734610 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-812bd186-ae96-4701-95b9-dda1d130f3cd tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:23.742412 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-812bd186-ae96-4701-95b9-dda1d130f3cd tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a" status: 200 len: 1361 microversion: 2.1 time: 0.150483 May 10 21:25:23.743005 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 336/668] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:23 2022] GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:25:23.927352 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-f314d78d-75f4-4bd7-b675-6d3519b6d140 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:23.927853 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-f314d78d-75f4-4bd7-b675-6d3519b6d140 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:23.934680 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f314d78d-75f4-4bd7-b675-6d3519b6d140 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:23.935233 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f314d78d-75f4-4bd7-b675-6d3519b6d140 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:23.936061 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f314d78d-75f4-4bd7-b675-6d3519b6d140 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:23.936386 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f314d78d-75f4-4bd7-b675-6d3519b6d140 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:24.001694 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-f314d78d-75f4-4bd7-b675-6d3519b6d140 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02af0eded57547f489be63cd6dc09399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78072ca90bf6402b83863597c266a178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:24.010232 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-f314d78d-75f4-4bd7-b675-6d3519b6d140 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad" status: 200 len: 1307 microversion: 2.1 time: 0.086739 May 10 21:25:24.014597 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 337/669] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:23 2022] GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad => generated 1307 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:25:24.507212 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-41babb2b-db4e-44bb-8917-0e09a5441c39 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "POST /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.577470 May 10 21:25:24.507942 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 333/670] 10.222.0.25 () {60 vars in 1322 bytes} [Tue May 10 21:25:22 2022] POST /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc/os-volume_attachments => generated 194 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:25:24.814047 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4688e7dd-5e6a-4043-b411-f8867708b1f6 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:24.818849 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-4688e7dd-5e6a-4043-b411-f8867708b1f6 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: 5141f323-2d73-494e-a167-49a618d1f67a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:24.820652 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4688e7dd-5e6a-4043-b411-f8867708b1f6 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:24.821102 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4688e7dd-5e6a-4043-b411-f8867708b1f6 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:24.821868 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4688e7dd-5e6a-4043-b411-f8867708b1f6 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:24.822304 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4688e7dd-5e6a-4043-b411-f8867708b1f6 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:24.951808 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-4688e7dd-5e6a-4043-b411-f8867708b1f6 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:24.959170 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4688e7dd-5e6a-4043-b411-f8867708b1f6 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a" status: 200 len: 1361 microversion: 2.1 time: 0.203859 May 10 21:25:24.959737 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 338/671] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:24 2022] GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a => generated 1361 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:25.029371 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-c1dc5f24-9c2e-4b9b-a67c-4827465501f8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:25.030058 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-c1dc5f24-9c2e-4b9b-a67c-4827465501f8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] [instance: e4ec9c2a-8806-4da8-9072-ca136cfa83ad] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:25.036383 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c1dc5f24-9c2e-4b9b-a67c-4827465501f8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:25.036821 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c1dc5f24-9c2e-4b9b-a67c-4827465501f8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:25.037573 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c1dc5f24-9c2e-4b9b-a67c-4827465501f8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:25.037996 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c1dc5f24-9c2e-4b9b-a67c-4827465501f8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:25.051163 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.wsgi [None req-c1dc5f24-9c2e-4b9b-a67c-4827465501f8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] HTTP exception thrown: Instance e4ec9c2a-8806-4da8-9072-ca136cfa83ad could not be found. May 10 21:25:25.052761 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-c1dc5f24-9c2e-4b9b-a67c-4827465501f8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Request method failure captured: May 10 21:25:25.052761 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: request: GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad HTTP/1.1 May 10 21:25:25.052761 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept: application/json May 10 21:25:25.052761 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept-Encoding: identity May 10 21:25:25.052761 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Connection: close May 10 21:25:25.052761 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Length: 0 May 10 21:25:25.052761 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Type: application/json May 10 21:25:25.052761 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Host: 10.222.0.25 May 10 21:25:25.052761 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Openstack-System-Scope: None May 10 21:25:25.052761 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: User-Agent: python-urllib3/1.26.9 May 10 21:25:25.052761 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Auth-Token: gAAAAABietceoa2YDFp3vDe6jovGDog94X8BICE9yqvDWgY5jdGYdkHB2lHnE5qpy-JGn-DuIb7JDkx8klyX_PhGtRnUB4IyuUehUiSCq89-lTpBX74SCgCRj4KBQmjjs3BGumQQ03DMZXdd0ZUBAC18LfTUVRuOE-vNOyfC2OTzFN94f1GAdHA May 10 21:25:25.052761 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Id: None May 10 21:25:25.052761 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Name: None May 10 21:25:25.052761 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Identity-Status: Confirmed May 10 21:25:25.052761 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Is-Admin-Project: True May 10 21:25:25.052761 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Id: default May 10 21:25:25.052761 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Name: Default May 10 21:25:25.052761 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Id: 78072ca90bf6402b83863597c266a178 May 10 21:25:25.052761 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-845733436 May 10 21:25:25.052761 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Role: member,reader May 10 21:25:25.052761 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Roles: member,reader May 10 21:25:25.054538 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78072ca90bf6402b83863597c266a178"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_78072ca90bf6402b83863597c266a178"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78072ca90bf6402b83863597c266a178"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/78072ca90bf6402b83863597c266a178"}]}] May 10 21:25:25.054538 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant: tempest-ServerRescueNegativeTestJSON-845733436 May 10 21:25:25.054538 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Id: 78072ca90bf6402b83863597c266a178 May 10 21:25:25.054538 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-845733436 May 10 21:25:25.054538 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User: tempest-ServerRescueNegativeTestJSON-845733436-project May 10 21:25:25.054538 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Id: default May 10 21:25:25.054538 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Name: Default May 10 21:25:25.054538 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Id: 02af0eded57547f489be63cd6dc09399 May 10 21:25:25.054538 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Name: tempest-ServerRescueNegativeTestJSON-845733436-project May 10 21:25:25.054538 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: method: > May 10 21:25:25.054538 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: exception: Instance e4ec9c2a-8806-4da8-9072-ca136cfa83ad could not be found. May 10 21:25:25.054538 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: action_args: {'id': 'e4ec9c2a-8806-4da8-9072-ca136cfa83ad'} May 10 21:25:25.055597 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:25:25.055597 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:25.055597 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:25:25.055597 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:25:25.055597 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:25:25.055597 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:25:25.055597 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:25:25.055597 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:25:25.055597 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:25:25.055597 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:25:25.055597 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4ec9c2a-8806-4da8-9072-ca136cfa83ad could not be found. May 10 21:25:25.055597 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:25:25.055597 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:25:25.055597 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:25:25.055597 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:25.055597 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:25:25.055597 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:25:25.055597 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:25:25.055597 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:25:25.055597 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:25:25.057063 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:25:25.057063 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:25:25.057063 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:25:25.057063 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:25:25.057063 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:25:25.057063 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:25:25.057063 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:25:25.057063 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4ec9c2a-8806-4da8-9072-ca136cfa83ad could not be found. May 10 21:25:25.057063 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:25:25.057063 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:25:25.057063 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:25:25.057063 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:25.057063 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:25:25.057063 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:25:25.057063 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:25:25.057063 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:25:25.057063 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4ec9c2a-8806-4da8-9072-ca136cfa83ad could not be found. May 10 21:25:25.057063 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:25:25.058534 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-c1dc5f24-9c2e-4b9b-a67c-4827465501f8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] Returning 404 to user: Instance e4ec9c2a-8806-4da8-9072-ca136cfa83ad could not be found. {{(pid=117678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:25:25.058534 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-c1dc5f24-9c2e-4b9b-a67c-4827465501f8 tempest-ServerRescueNegativeTestJSON-845733436 tempest-ServerRescueNegativeTestJSON-845733436-project] 10.222.0.25 "GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad" status: 404 len: 111 microversion: 2.1 time: 0.029696 May 10 21:25:25.058534 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 334/672] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:25 2022] GET /compute/v2.1/servers/e4ec9c2a-8806-4da8-9072-ca136cfa83ad => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:25:25.976779 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-0eed0bad-0d3a-4641-9361-ff57860f0cdd tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:25.977383 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-0eed0bad-0d3a-4641-9361-ff57860f0cdd tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: 5141f323-2d73-494e-a167-49a618d1f67a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:25.983674 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0eed0bad-0d3a-4641-9361-ff57860f0cdd tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:25.984115 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0eed0bad-0d3a-4641-9361-ff57860f0cdd tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:25.984872 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0eed0bad-0d3a-4641-9361-ff57860f0cdd tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:25.985301 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0eed0bad-0d3a-4641-9361-ff57860f0cdd tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:26.179659 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-0eed0bad-0d3a-4641-9361-ff57860f0cdd tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:26.186847 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-0eed0bad-0d3a-4641-9361-ff57860f0cdd tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a" status: 200 len: 1361 microversion: 2.1 time: 0.214347 May 10 21:25:26.187421 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 339/673] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:25 2022] GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a => generated 1361 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:27.204908 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-9bd65e10-0392-4457-97ec-853eb3e32144 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:27.205681 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-9bd65e10-0392-4457-97ec-853eb3e32144 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: 5141f323-2d73-494e-a167-49a618d1f67a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:27.212877 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9bd65e10-0392-4457-97ec-853eb3e32144 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:27.213705 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9bd65e10-0392-4457-97ec-853eb3e32144 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:27.214807 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9bd65e10-0392-4457-97ec-853eb3e32144 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:27.215357 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9bd65e10-0392-4457-97ec-853eb3e32144 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:27.358248 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-9bd65e10-0392-4457-97ec-853eb3e32144 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:27.369835 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-9bd65e10-0392-4457-97ec-853eb3e32144 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a" status: 200 len: 1361 microversion: 2.1 time: 0.169144 May 10 21:25:27.379490 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 335/674] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:27 2022] GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:27.716582 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-5a124fad-ab60-45a1-8045-d36ad6482b61 req-37fcdf05-1d6d-4d49-96ec-7b76332d44e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5141f323-2d73-494e-a167-49a618d1f67a", "name": "network-vif-plugged", "status": "completed", "tag": "04a8540b-67b6-4a39-b9c9-65408369b364"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:25:27.727673 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-5a124fad-ab60-45a1-8045-d36ad6482b61 req-37fcdf05-1d6d-4d49-96ec-7b76332d44e2 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:27.728119 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-5a124fad-ab60-45a1-8045-d36ad6482b61 req-37fcdf05-1d6d-4d49-96ec-7b76332d44e2 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:27.738968 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-5a124fad-ab60-45a1-8045-d36ad6482b61 req-37fcdf05-1d6d-4d49-96ec-7b76332d44e2 service nova] Creating event network-vif-plugged:04a8540b-67b6-4a39-b9c9-65408369b364 for instance 5141f323-2d73-494e-a167-49a618d1f67a on hv-cinder-83608 May 10 21:25:27.743909 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-5a124fad-ab60-45a1-8045-d36ad6482b61 req-37fcdf05-1d6d-4d49-96ec-7b76332d44e2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034734 May 10 21:25:27.744724 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 340/675] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:25:28.389304 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-0faed4b0-46ff-4b0f-b93f-06fc74fc09c4 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:28.389994 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-0faed4b0-46ff-4b0f-b93f-06fc74fc09c4 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: 5141f323-2d73-494e-a167-49a618d1f67a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:28.397180 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0faed4b0-46ff-4b0f-b93f-06fc74fc09c4 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:28.397733 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0faed4b0-46ff-4b0f-b93f-06fc74fc09c4 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:28.399137 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0faed4b0-46ff-4b0f-b93f-06fc74fc09c4 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:28.399806 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0faed4b0-46ff-4b0f-b93f-06fc74fc09c4 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:28.615895 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-0faed4b0-46ff-4b0f-b93f-06fc74fc09c4 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:28.624251 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-0faed4b0-46ff-4b0f-b93f-06fc74fc09c4 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a" status: 200 len: 1361 microversion: 2.1 time: 0.239925 May 10 21:25:28.624850 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 336/676] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:28 2022] GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a => generated 1361 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:29.642182 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-593363fd-886e-40f3-93c9-90b4b998f4e5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:29.642894 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-593363fd-886e-40f3-93c9-90b4b998f4e5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: 5141f323-2d73-494e-a167-49a618d1f67a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:29.649835 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-593363fd-886e-40f3-93c9-90b4b998f4e5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:29.650265 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-593363fd-886e-40f3-93c9-90b4b998f4e5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:29.651068 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-593363fd-886e-40f3-93c9-90b4b998f4e5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:29.651500 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-593363fd-886e-40f3-93c9-90b4b998f4e5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:29.786150 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-593363fd-886e-40f3-93c9-90b4b998f4e5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:29.793742 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-593363fd-886e-40f3-93c9-90b4b998f4e5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a" status: 200 len: 1361 microversion: 2.1 time: 0.156127 May 10 21:25:29.794323 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 341/677] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:29 2022] GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:30.811356 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-def330cb-3968-476b-9863-c2bcdd5cd605 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:30.811962 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-def330cb-3968-476b-9863-c2bcdd5cd605 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: 5141f323-2d73-494e-a167-49a618d1f67a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:30.818332 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-def330cb-3968-476b-9863-c2bcdd5cd605 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:30.818810 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-def330cb-3968-476b-9863-c2bcdd5cd605 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:30.819570 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-def330cb-3968-476b-9863-c2bcdd5cd605 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:30.820639 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-def330cb-3968-476b-9863-c2bcdd5cd605 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:30.957572 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-def330cb-3968-476b-9863-c2bcdd5cd605 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:30.965429 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-def330cb-3968-476b-9863-c2bcdd5cd605 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a" status: 200 len: 1547 microversion: 2.1 time: 0.157910 May 10 21:25:30.976867 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 337/678] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:30 2022] GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a => generated 1547 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:30.990168 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-d5da5479-6876-49f9-b1ad-4fe3b6ff08a4 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:30.990168 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-d5da5479-6876-49f9-b1ad-4fe3b6ff08a4 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: 5141f323-2d73-494e-a167-49a618d1f67a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:30.990168 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d5da5479-6876-49f9-b1ad-4fe3b6ff08a4 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:30.990168 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d5da5479-6876-49f9-b1ad-4fe3b6ff08a4 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:30.991142 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d5da5479-6876-49f9-b1ad-4fe3b6ff08a4 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:30.991142 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d5da5479-6876-49f9-b1ad-4fe3b6ff08a4 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:31.085157 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-d5da5479-6876-49f9-b1ad-4fe3b6ff08a4 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106650 May 10 21:25:31.086408 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 342/679] 10.222.0.25 () {58 vars in 1274 bytes} [Tue May 10 21:25:30 2022] GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:25:32.219018 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-2210a82a-4093-4feb-9000-7d3e273b306d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ddb12a4-5f09-40c0-b7a3-10062218b14e"}} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:25:32.220351 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-2210a82a-4093-4feb-9000-7d3e273b306d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 11411cb5-9de1-4ea1-8cdf-e770019076dc] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:32.226765 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2210a82a-4093-4feb-9000-7d3e273b306d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:32.227308 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2210a82a-4093-4feb-9000-7d3e273b306d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:32.228167 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2210a82a-4093-4feb-9000-7d3e273b306d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:32.228678 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2210a82a-4093-4feb-9000-7d3e273b306d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:32.317526 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-f158a139-eaf5-4795-87f6-704c208a0b7b tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1295255861"}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:25:32.317526 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-f158a139-eaf5-4795-87f6-704c208a0b7b tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:32.318094 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.wsgi [None req-2210a82a-4093-4feb-9000-7d3e273b306d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] HTTP exception thrown: Invalid volume: volume 2ddb12a4-5f09-40c0-b7a3-10062218b14e is already attached to instances: 11411cb5-9de1-4ea1-8cdf-e770019076dc May 10 21:25:32.319983 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-2210a82a-4093-4feb-9000-7d3e273b306d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Request method failure captured: May 10 21:25:32.319983 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: request: POST /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc/os-volume_attachments HTTP/1.1 May 10 21:25:32.319983 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept: application/json May 10 21:25:32.319983 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept-Encoding: identity May 10 21:25:32.319983 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Connection: close May 10 21:25:32.319983 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Length: 74 May 10 21:25:32.319983 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Type: application/json May 10 21:25:32.319983 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Host: 10.222.0.25 May 10 21:25:32.319983 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Openstack-System-Scope: None May 10 21:25:32.319983 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: User-Agent: python-urllib3/1.26.9 May 10 21:25:32.319983 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Auth-Token: gAAAAABietccfViYRiOQpEa4ldvOHZyUgOQ2ZBBatS9SA20GCDt_AgmFvo4vE33WkYc6oqnMaRFSIYJbwKR_AxZ5OfoHdxsDJwPaySjCJQ5rrDhZmJbbtmsjCkN_RYEyYX6qvdoHvFk_bXj7SkSAx705IP0l1sxFz6bBTFTgIB8EAyrOf7pHKV8 May 10 21:25:32.319983 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Id: None May 10 21:25:32.319983 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Name: None May 10 21:25:32.319983 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Identity-Status: Confirmed May 10 21:25:32.319983 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Is-Admin-Project: True May 10 21:25:32.319983 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Id: default May 10 21:25:32.319983 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Name: Default May 10 21:25:32.319983 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Id: 8286226c580f4896aec72c65642fce30 May 10 21:25:32.319983 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Name: tempest-AttachVolumeNegativeTest-1863330069 May 10 21:25:32.319983 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Role: member,reader May 10 21:25:32.319983 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Roles: member,reader May 10 21:25:32.321982 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8286226c580f4896aec72c65642fce30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8286226c580f4896aec72c65642fce30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8286226c580f4896aec72c65642fce30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8286226c580f4896aec72c65642fce30"}]}] May 10 21:25:32.321982 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant: tempest-AttachVolumeNegativeTest-1863330069 May 10 21:25:32.321982 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Id: 8286226c580f4896aec72c65642fce30 May 10 21:25:32.321982 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1863330069 May 10 21:25:32.321982 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User: tempest-AttachVolumeNegativeTest-1863330069-project May 10 21:25:32.321982 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Id: default May 10 21:25:32.321982 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Name: Default May 10 21:25:32.321982 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Id: ca39678abe6e476283f94c675d4ea369 May 10 21:25:32.321982 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Name: tempest-AttachVolumeNegativeTest-1863330069-project May 10 21:25:32.321982 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: May 10 21:25:32.321982 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: {"volumeAttachment": {"volumeId": "2ddb12a4-5f09-40c0-b7a3-10062218b14e"}} May 10 21:25:32.321982 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: method: > May 10 21:25:32.322766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: exception: Invalid volume: volume 2ddb12a4-5f09-40c0-b7a3-10062218b14e is already attached to instances: 11411cb5-9de1-4ea1-8cdf-e770019076dc May 10 21:25:32.322766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: action_args: {'server_id': '11411cb5-9de1-4ea1-8cdf-e770019076dc', 'body': {'volumeAttachment': {'volumeId': '2ddb12a4-5f09-40c0-b7a3-10062218b14e'}}} May 10 21:25:32.322766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:25:32.322766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:32.322766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 10 21:25:32.322766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 10 21:25:32.322766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 21:25:32.322766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 21:25:32.322766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 10 21:25:32.322766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 21:25:32.322766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 10 21:25:32.322766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 10 21:25:32.322766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 10 21:25:32.322766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 10 21:25:32.322766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2ddb12a4-5f09-40c0-b7a3-10062218b14e is already attached to instances: 11411cb5-9de1-4ea1-8cdf-e770019076dc May 10 21:25:32.322766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:25:32.322766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:25:32.322766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:25:32.322766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:32.325196 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:25:32.325196 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:25:32.325196 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:25:32.325196 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:25:32.325196 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:25:32.325196 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:25:32.325196 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 21:25:32.325196 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 21:25:32.325196 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 21:25:32.325196 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 21:25:32.325196 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 21:25:32.325196 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 21:25:32.325196 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 10 21:25:32.325196 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 10 21:25:32.325196 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2ddb12a4-5f09-40c0-b7a3-10062218b14e is already attached to instances: 11411cb5-9de1-4ea1-8cdf-e770019076dc May 10 21:25:32.325196 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:25:32.325196 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:25:32.325196 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:25:32.325196 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:32.325196 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:25:32.327958 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:25:32.327958 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:25:32.327958 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:25:32.327958 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2ddb12a4-5f09-40c0-b7a3-10062218b14e is already attached to instances: 11411cb5-9de1-4ea1-8cdf-e770019076dc May 10 21:25:32.327958 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:25:32.327958 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-2210a82a-4093-4feb-9000-7d3e273b306d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Returning 400 to user: Invalid volume: volume 2ddb12a4-5f09-40c0-b7a3-10062218b14e is already attached to instances: 11411cb5-9de1-4ea1-8cdf-e770019076dc {{(pid=117678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:25:32.327958 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-2210a82a-4093-4feb-9000-7d3e273b306d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "POST /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107838 May 10 21:25:32.329026 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f158a139-eaf5-4795-87f6-704c208a0b7b tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:32.329026 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f158a139-eaf5-4795-87f6-704c208a0b7b tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:32.329026 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f158a139-eaf5-4795-87f6-704c208a0b7b tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:32.329026 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f158a139-eaf5-4795-87f6-704c208a0b7b tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:32.329567 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 338/680] 10.222.0.25 () {60 vars in 1322 bytes} [Tue May 10 21:25:32 2022] POST /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc/os-volume_attachments => generated 174 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 21:25:32.389399 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-347f191d-644c-4875-b863-c127d988255c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:32.389896 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-347f191d-644c-4875-b863-c127d988255c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 11411cb5-9de1-4ea1-8cdf-e770019076dc] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:32.396139 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-347f191d-644c-4875-b863-c127d988255c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:32.396587 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-347f191d-644c-4875-b863-c127d988255c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:32.397397 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-347f191d-644c-4875-b863-c127d988255c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:32.397834 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-347f191d-644c-4875-b863-c127d988255c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:32.486637 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.objects.instance [None req-347f191d-644c-4875-b863-c127d988255c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lazy-loading 'services' on Instance uuid 11411cb5-9de1-4ea1-8cdf-e770019076dc {{(pid=117678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:25:32.668366 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.network.security_group_api [None req-f158a139-eaf5-4795-87f6-704c208a0b7b tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Removing security group 118aa708-707e-48dc-9d81-57a3a4a5dcbd from port 00f67420-6c95-4cc5-8544-bceeed674619 May 10 21:25:32.728054 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-347f191d-644c-4875-b863-c127d988255c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "DELETE /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc/os-volume_attachments/2ddb12a4-5f09-40c0-b7a3-10062218b14e" status: 202 len: 0 microversion: 2.1 time: 0.340100 May 10 21:25:32.730546 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 339/681] 10.222.0.25 () {58 vars in 1415 bytes} [Tue May 10 21:25:32 2022] DELETE /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc/os-volume_attachments/2ddb12a4-5f09-40c0-b7a3-10062218b14e => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 21:25:32.754386 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-cbb08723-0063-4b92-adef-dff833fe2e4d req-91aaf1e1-e2b0-4637-8646-d3269eaab233 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5141f323-2d73-494e-a167-49a618d1f67a", "tag": "04a8540b-67b6-4a39-b9c9-65408369b364"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:25:32.776720 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-cbb08723-0063-4b92-adef-dff833fe2e4d req-91aaf1e1-e2b0-4637-8646-d3269eaab233 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:32.779178 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-cbb08723-0063-4b92-adef-dff833fe2e4d req-91aaf1e1-e2b0-4637-8646-d3269eaab233 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:32.803934 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-cbb08723-0063-4b92-adef-dff833fe2e4d req-91aaf1e1-e2b0-4637-8646-d3269eaab233 service nova] Creating event network-changed:04a8540b-67b6-4a39-b9c9-65408369b364 for instance 5141f323-2d73-494e-a167-49a618d1f67a on hv-cinder-83608 May 10 21:25:32.816873 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-cbb08723-0063-4b92-adef-dff833fe2e4d req-91aaf1e1-e2b0-4637-8646-d3269eaab233 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086155 May 10 21:25:32.818798 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 340/682] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:25:32.849798 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-4aec93ca-97e1-486a-9d70-0b6f120b6858 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:32.850876 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-4aec93ca-97e1-486a-9d70-0b6f120b6858 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 11411cb5-9de1-4ea1-8cdf-e770019076dc] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:32.876131 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4aec93ca-97e1-486a-9d70-0b6f120b6858 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:32.876585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4aec93ca-97e1-486a-9d70-0b6f120b6858 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:32.877552 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4aec93ca-97e1-486a-9d70-0b6f120b6858 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:32.879190 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4aec93ca-97e1-486a-9d70-0b6f120b6858 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:32.920716 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-4aec93ca-97e1-486a-9d70-0b6f120b6858 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100273 May 10 21:25:32.921948 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 341/683] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 10 21:25:32 2022] GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:25:33.292901 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-f158a139-eaf5-4795-87f6-704c208a0b7b tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "POST /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241/action" status: 202 len: 0 microversion: 2.1 time: 0.981103 May 10 21:25:33.300831 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 343/684] 10.222.0.25 () {60 vars in 1277 bytes} [Tue May 10 21:25:32 2022] POST /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241/action => generated 0 bytes in 989 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 21:25:33.934209 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-afa60e3e-d0f6-4ef5-bc86-41b8b85c7778 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:33.935822 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-afa60e3e-d0f6-4ef5-bc86-41b8b85c7778 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 11411cb5-9de1-4ea1-8cdf-e770019076dc] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:33.943865 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-afa60e3e-d0f6-4ef5-bc86-41b8b85c7778 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:33.944131 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-afa60e3e-d0f6-4ef5-bc86-41b8b85c7778 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:33.945641 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-afa60e3e-d0f6-4ef5-bc86-41b8b85c7778 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:33.946421 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-afa60e3e-d0f6-4ef5-bc86-41b8b85c7778 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:33.987893 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-afa60e3e-d0f6-4ef5-bc86-41b8b85c7778 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056786 May 10 21:25:33.987893 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 342/685] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 10 21:25:33 2022] GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 21:25:34.055119 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4a587c8a-40d2-4af6-ac3b-7a42176ce9b6 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:34.055838 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-4a587c8a-40d2-4af6-ac3b-7a42176ce9b6 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 11411cb5-9de1-4ea1-8cdf-e770019076dc] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:34.070983 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4a587c8a-40d2-4af6-ac3b-7a42176ce9b6 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:34.071880 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4a587c8a-40d2-4af6-ac3b-7a42176ce9b6 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:34.073601 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4a587c8a-40d2-4af6-ac3b-7a42176ce9b6 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:34.074227 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4a587c8a-40d2-4af6-ac3b-7a42176ce9b6 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:34.111441 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-4a587c8a-40d2-4af6-ac3b-7a42176ce9b6 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 11411cb5-9de1-4ea1-8cdf-e770019076dc] Going to try to terminate instance {{(pid=117679) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 21:25:34.354540 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4a587c8a-40d2-4af6-ac3b-7a42176ce9b6 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "DELETE /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc" status: 204 len: 0 microversion: 2.1 time: 0.303638 May 10 21:25:34.356400 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 344/686] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 10 21:25:34 2022] DELETE /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 21:25:34.363526 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-708ab4ea-c6e2-459b-bd00-65d64329d4b1 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:34.364261 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-708ab4ea-c6e2-459b-bd00-65d64329d4b1 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 11411cb5-9de1-4ea1-8cdf-e770019076dc] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:34.371395 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-708ab4ea-c6e2-459b-bd00-65d64329d4b1 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:34.372209 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-708ab4ea-c6e2-459b-bd00-65d64329d4b1 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:34.373242 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-708ab4ea-c6e2-459b-bd00-65d64329d4b1 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:34.373762 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-708ab4ea-c6e2-459b-bd00-65d64329d4b1 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:34.632245 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-708ab4ea-c6e2-459b-bd00-65d64329d4b1 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:34.641214 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-708ab4ea-c6e2-459b-bd00-65d64329d4b1 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc" status: 200 len: 1683 microversion: 2.1 time: 0.281684 May 10 21:25:34.641925 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 343/687] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:34 2022] GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc => generated 1683 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:25:34.848868 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-568ea635-300b-43ae-93d0-3aca63153878 req-db8b90b2-f4d6-4f38-82d5-1b239aeb1022 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4f87d15-87fb-4ada-8b58-6fa220505241", "tag": "00f67420-6c95-4cc5-8544-bceeed674619"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:25:34.867205 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-568ea635-300b-43ae-93d0-3aca63153878 req-db8b90b2-f4d6-4f38-82d5-1b239aeb1022 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:34.868579 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-1c643e7b-82ae-4d31-8302-cb859d63c222 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:34.868969 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-568ea635-300b-43ae-93d0-3aca63153878 req-db8b90b2-f4d6-4f38-82d5-1b239aeb1022 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:34.869842 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-1c643e7b-82ae-4d31-8302-cb859d63c222 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:34.875962 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1c643e7b-82ae-4d31-8302-cb859d63c222 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:34.876420 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1c643e7b-82ae-4d31-8302-cb859d63c222 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:34.877393 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1c643e7b-82ae-4d31-8302-cb859d63c222 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:34.877827 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1c643e7b-82ae-4d31-8302-cb859d63c222 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:34.881443 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-568ea635-300b-43ae-93d0-3aca63153878 req-db8b90b2-f4d6-4f38-82d5-1b239aeb1022 service nova] Creating event network-changed:00f67420-6c95-4cc5-8544-bceeed674619 for instance c4f87d15-87fb-4ada-8b58-6fa220505241 on hv-cinder-83608 May 10 21:25:34.888002 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-568ea635-300b-43ae-93d0-3aca63153878 req-db8b90b2-f4d6-4f38-82d5-1b239aeb1022 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043649 May 10 21:25:34.892538 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 345/688] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:25:34.972615 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.objects.instance [None req-1c643e7b-82ae-4d31-8302-cb859d63c222 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lazy-loading 'services' on Instance uuid c4f87d15-87fb-4ada-8b58-6fa220505241 {{(pid=117678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:25:35.149419 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-7e307f2c-5dd7-4908-8df1-09302a83b529 req-cc7e5ffe-b6b1-4adf-b361-43870fc36496 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4f87d15-87fb-4ada-8b58-6fa220505241", "tag": "00f67420-6c95-4cc5-8544-bceeed674619"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:25:35.158939 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-7e307f2c-5dd7-4908-8df1-09302a83b529 req-cc7e5ffe-b6b1-4adf-b361-43870fc36496 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:35.159718 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-7e307f2c-5dd7-4908-8df1-09302a83b529 req-cc7e5ffe-b6b1-4adf-b361-43870fc36496 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:35.166910 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-1c643e7b-82ae-4d31-8302-cb859d63c222 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241/os-volume_attachments/27358427-528a-4112-bc13-bbf4a79810c6" status: 202 len: 0 microversion: 2.1 time: 0.303884 May 10 21:25:35.167576 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 344/689] 10.222.0.25 () {58 vars in 1415 bytes} [Tue May 10 21:25:34 2022] DELETE /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241/os-volume_attachments/27358427-528a-4112-bc13-bbf4a79810c6 => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 21:25:35.174303 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-7e307f2c-5dd7-4908-8df1-09302a83b529 req-cc7e5ffe-b6b1-4adf-b361-43870fc36496 service nova] Creating event network-changed:00f67420-6c95-4cc5-8544-bceeed674619 for instance c4f87d15-87fb-4ada-8b58-6fa220505241 on hv-cinder-83608 May 10 21:25:35.177145 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-2fb4ab5b-77d3-4f84-a9e3-50c34e8a7248 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:35.179171 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-2fb4ab5b-77d3-4f84-a9e3-50c34e8a7248 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:35.180397 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-7e307f2c-5dd7-4908-8df1-09302a83b529 req-cc7e5ffe-b6b1-4adf-b361-43870fc36496 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.289880 May 10 21:25:35.181242 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 346/690] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:25:35.188281 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2fb4ab5b-77d3-4f84-a9e3-50c34e8a7248 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:35.189740 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2fb4ab5b-77d3-4f84-a9e3-50c34e8a7248 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:35.191425 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2fb4ab5b-77d3-4f84-a9e3-50c34e8a7248 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:35.192065 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2fb4ab5b-77d3-4f84-a9e3-50c34e8a7248 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:35.229080 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-2fb4ab5b-77d3-4f84-a9e3-50c34e8a7248 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057126 May 10 21:25:35.234571 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 345/691] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 10 21:25:35 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:25:35.659439 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-871820ff-bff1-4f1d-82cb-b998456f5987 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:35.660169 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-871820ff-bff1-4f1d-82cb-b998456f5987 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 11411cb5-9de1-4ea1-8cdf-e770019076dc] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:35.667102 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-871820ff-bff1-4f1d-82cb-b998456f5987 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:35.667582 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-871820ff-bff1-4f1d-82cb-b998456f5987 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:35.668352 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-871820ff-bff1-4f1d-82cb-b998456f5987 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:35.668781 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-871820ff-bff1-4f1d-82cb-b998456f5987 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:35.896020 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-871820ff-bff1-4f1d-82cb-b998456f5987 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:35.907490 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-871820ff-bff1-4f1d-82cb-b998456f5987 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc" status: 200 len: 1683 microversion: 2.1 time: 0.251574 May 10 21:25:35.909690 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 347/692] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:35 2022] GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc => generated 1683 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:25:36.242310 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-8c393832-07be-4e23-9164-07866ed57be5 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:36.243529 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-8c393832-07be-4e23-9164-07866ed57be5 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:36.249949 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8c393832-07be-4e23-9164-07866ed57be5 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:36.250397 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8c393832-07be-4e23-9164-07866ed57be5 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:36.251275 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8c393832-07be-4e23-9164-07866ed57be5 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:36.251707 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8c393832-07be-4e23-9164-07866ed57be5 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:36.284108 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-8c393832-07be-4e23-9164-07866ed57be5 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046062 May 10 21:25:36.284695 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 346/693] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 10 21:25:36 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:25:36.926185 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-35c7c76e-6874-4f78-8f6d-1b1f3aca61df tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:36.926890 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-35c7c76e-6874-4f78-8f6d-1b1f3aca61df tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 11411cb5-9de1-4ea1-8cdf-e770019076dc] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:36.934308 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-35c7c76e-6874-4f78-8f6d-1b1f3aca61df tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:36.934850 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-35c7c76e-6874-4f78-8f6d-1b1f3aca61df tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:36.935675 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-35c7c76e-6874-4f78-8f6d-1b1f3aca61df tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:36.936170 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-35c7c76e-6874-4f78-8f6d-1b1f3aca61df tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:37.287193 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-35c7c76e-6874-4f78-8f6d-1b1f3aca61df tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:37.296659 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-754cf0dc-c328-4c41-b96e-0da130435da3 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:37.297566 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-35c7c76e-6874-4f78-8f6d-1b1f3aca61df tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc" status: 200 len: 1683 microversion: 2.1 time: 0.375162 May 10 21:25:37.298143 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 348/694] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:36 2022] GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc => generated 1683 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:37.298478 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-754cf0dc-c328-4c41-b96e-0da130435da3 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:37.305712 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-754cf0dc-c328-4c41-b96e-0da130435da3 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:37.308400 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-754cf0dc-c328-4c41-b96e-0da130435da3 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:37.308400 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-754cf0dc-c328-4c41-b96e-0da130435da3 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:37.308400 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-754cf0dc-c328-4c41-b96e-0da130435da3 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:37.340624 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-754cf0dc-c328-4c41-b96e-0da130435da3 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048571 May 10 21:25:37.341321 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 347/695] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 10 21:25:37 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 10 21:25:37.351016 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e4e3ae73-915c-494b-90e7-c56e3b53b791 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:37.351741 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-e4e3ae73-915c-494b-90e7-c56e3b53b791 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:37.358212 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e4e3ae73-915c-494b-90e7-c56e3b53b791 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:37.358767 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e4e3ae73-915c-494b-90e7-c56e3b53b791 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:37.359592 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e4e3ae73-915c-494b-90e7-c56e3b53b791 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:37.360082 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e4e3ae73-915c-494b-90e7-c56e3b53b791 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:37.443784 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-e4e3ae73-915c-494b-90e7-c56e3b53b791 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] HTTP exception thrown: Instance c4f87d15-87fb-4ada-8b58-6fa220505241 is not attached to volume 27358427-528a-4112-bc13-bbf4a79810c6 May 10 21:25:37.455052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e4e3ae73-915c-494b-90e7-c56e3b53b791 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Request method failure captured: May 10 21:25:37.455052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: request: DELETE /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241/os-volume_attachments/27358427-528a-4112-bc13-bbf4a79810c6 HTTP/1.1 May 10 21:25:37.455052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept: application/json May 10 21:25:37.455052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity May 10 21:25:37.455052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Connection: close May 10 21:25:37.455052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Length: 0 May 10 21:25:37.455052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Type: application/json May 10 21:25:37.455052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Host: 10.222.0.25 May 10 21:25:37.455052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None May 10 21:25:37.455052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 May 10 21:25:37.455052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABietex_-WM0csCd8flplZNjbA0R8f08bJsg3esYE65NjNfizZ59kVs0TQrIvWTL471X5GmajdqIbnLu8olKYFg_WhF7KJaRonaijeGaHWSZt2ZahPWNi1ahDobwjwv6G0PCWbyx37VXTqX9ztYKgN2PJpMmNsARm9QJeq6peLxR0tLssU May 10 21:25:37.455052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Id: None May 10 21:25:37.455052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Name: None May 10 21:25:37.455052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed May 10 21:25:37.455052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True May 10 21:25:37.455052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default May 10 21:25:37.455052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default May 10 21:25:37.455052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Id: 7858ff72ee9843a493c27f9592a540b0 May 10 21:25:37.455052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-TestMinimumBasicScenario-1704501838 May 10 21:25:37.455052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Role: member,reader May 10 21:25:37.455052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Roles: member,reader May 10 21:25:37.456461 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7858ff72ee9843a493c27f9592a540b0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7858ff72ee9843a493c27f9592a540b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7858ff72ee9843a493c27f9592a540b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7858ff72ee9843a493c27f9592a540b0"}]}] May 10 21:25:37.456461 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-TestMinimumBasicScenario-1704501838 May 10 21:25:37.456461 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Id: 7858ff72ee9843a493c27f9592a540b0 May 10 21:25:37.456461 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1704501838 May 10 21:25:37.456461 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User: tempest-TestMinimumBasicScenario-1704501838-project May 10 21:25:37.456461 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default May 10 21:25:37.456461 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default May 10 21:25:37.456461 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Id: cee2a53cb70b4281bb49e39d70abfaa6 May 10 21:25:37.456461 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-TestMinimumBasicScenario-1704501838-project May 10 21:25:37.456461 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: method: > May 10 21:25:37.456461 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: exception: Instance c4f87d15-87fb-4ada-8b58-6fa220505241 is not attached to volume 27358427-528a-4112-bc13-bbf4a79810c6 May 10 21:25:37.457319 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: action_args: {'server_id': 'c4f87d15-87fb-4ada-8b58-6fa220505241', 'id': '27358427-528a-4112-bc13-bbf4a79810c6'} May 10 21:25:37.457319 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:25:37.457319 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:37.457319 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 10 21:25:37.457319 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 10 21:25:37.457319 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 21:25:37.457319 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 21:25:37.457319 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 10 21:25:37.457319 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 10 21:25:37.457319 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 27358427-528a-4112-bc13-bbf4a79810c6. May 10 21:25:37.457319 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:25:37.457319 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:25:37.457319 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:25:37.457319 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:37.457319 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:25:37.457319 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:25:37.457319 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:25:37.457319 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:25:37.457319 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:25:37.458464 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:25:37.458464 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 10 21:25:37.458464 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 10 21:25:37.458464 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4f87d15-87fb-4ada-8b58-6fa220505241 is not attached to volume 27358427-528a-4112-bc13-bbf4a79810c6 May 10 21:25:37.458464 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:25:37.458464 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:25:37.458464 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:25:37.458464 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:37.458464 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:25:37.458464 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:25:37.458464 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:25:37.458464 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:25:37.458464 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4f87d15-87fb-4ada-8b58-6fa220505241 is not attached to volume 27358427-528a-4112-bc13-bbf4a79810c6 May 10 21:25:37.458464 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:25:37.458464 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e4e3ae73-915c-494b-90e7-c56e3b53b791 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Returning 404 to user: Instance c4f87d15-87fb-4ada-8b58-6fa220505241 is not attached to volume 27358427-528a-4112-bc13-bbf4a79810c6 {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:25:37.459366 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-e4e3ae73-915c-494b-90e7-c56e3b53b791 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241/os-volume_attachments/27358427-528a-4112-bc13-bbf4a79810c6" status: 404 len: 154 microversion: 2.1 time: 0.109894 May 10 21:25:37.459366 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 349/696] 10.222.0.25 () {58 vars in 1415 bytes} [Tue May 10 21:25:37 2022] DELETE /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241/os-volume_attachments/27358427-528a-4112-bc13-bbf4a79810c6 => generated 154 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:25:38.315294 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-0236b613-83e8-4be1-8b62-1125571d3b89 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:38.317292 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-0236b613-83e8-4be1-8b62-1125571d3b89 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 11411cb5-9de1-4ea1-8cdf-e770019076dc] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:38.325145 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0236b613-83e8-4be1-8b62-1125571d3b89 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:38.325900 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0236b613-83e8-4be1-8b62-1125571d3b89 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:38.327463 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0236b613-83e8-4be1-8b62-1125571d3b89 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:38.328114 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0236b613-83e8-4be1-8b62-1125571d3b89 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:38.339976 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-2ea393f5-d2a1-46eb-ad29-10e8a3f33861 req-7109a622-db2a-4d36-a00b-325c28971f70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11411cb5-9de1-4ea1-8cdf-e770019076dc", "name": "network-vif-deleted", "tag": "78364b55-7109-42ce-bcd5-a6a00acfab88"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:25:38.348979 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-2ea393f5-d2a1-46eb-ad29-10e8a3f33861 req-7109a622-db2a-4d36-a00b-325c28971f70 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:38.349731 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-2ea393f5-d2a1-46eb-ad29-10e8a3f33861 req-7109a622-db2a-4d36-a00b-325c28971f70 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:38.365373 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-2ea393f5-d2a1-46eb-ad29-10e8a3f33861 req-7109a622-db2a-4d36-a00b-325c28971f70 service nova] Creating event network-vif-deleted:78364b55-7109-42ce-bcd5-a6a00acfab88 for instance 11411cb5-9de1-4ea1-8cdf-e770019076dc on hv-cinder-83608 May 10 21:25:38.373893 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-2ea393f5-d2a1-46eb-ad29-10e8a3f33861 req-7109a622-db2a-4d36-a00b-325c28971f70 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037446 May 10 21:25:38.377025 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 350/697] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:25:38.415096 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-0236b613-83e8-4be1-8b62-1125571d3b89 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:38.422811 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-0236b613-83e8-4be1-8b62-1125571d3b89 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc" status: 200 len: 1615 microversion: 2.1 time: 0.111309 May 10 21:25:38.424664 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 348/698] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:38 2022] GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc => generated 1615 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:38.763264 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-cc3e6e85-52d7-4ca4-a18e-b692e6296f18 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:38.764022 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-cc3e6e85-52d7-4ca4-a18e-b692e6296f18 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:38.770129 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cc3e6e85-52d7-4ca4-a18e-b692e6296f18 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:38.772840 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cc3e6e85-52d7-4ca4-a18e-b692e6296f18 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:38.772840 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cc3e6e85-52d7-4ca4-a18e-b692e6296f18 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:38.772840 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cc3e6e85-52d7-4ca4-a18e-b692e6296f18 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:38.798107 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-cc3e6e85-52d7-4ca4-a18e-b692e6296f18 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Going to try to terminate instance {{(pid=117679) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 21:25:39.082479 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-cc3e6e85-52d7-4ca4-a18e-b692e6296f18 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 204 len: 0 microversion: 2.1 time: 0.321934 May 10 21:25:39.088521 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 351/699] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 10 21:25:38 2022] DELETE /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 21:25:39.095358 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-102b6628-6d05-4e30-b9e5-1fdd9f57f532 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:39.096333 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-102b6628-6d05-4e30-b9e5-1fdd9f57f532 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:39.103465 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-102b6628-6d05-4e30-b9e5-1fdd9f57f532 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:39.103899 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-102b6628-6d05-4e30-b9e5-1fdd9f57f532 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:39.104856 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-102b6628-6d05-4e30-b9e5-1fdd9f57f532 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:39.105286 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-102b6628-6d05-4e30-b9e5-1fdd9f57f532 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:39.261592 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-102b6628-6d05-4e30-b9e5-1fdd9f57f532 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:39.269046 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-102b6628-6d05-4e30-b9e5-1fdd9f57f532 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1554 microversion: 2.1 time: 0.177463 May 10 21:25:39.270146 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 349/700] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:39 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1554 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:25:39.335295 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-5792f782-aeb5-485d-af45-b7b46f2303b7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:39.336737 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-5792f782-aeb5-485d-af45-b7b46f2303b7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:39.343052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5792f782-aeb5-485d-af45-b7b46f2303b7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:39.345803 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5792f782-aeb5-485d-af45-b7b46f2303b7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:39.345803 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5792f782-aeb5-485d-af45-b7b46f2303b7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:39.345803 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5792f782-aeb5-485d-af45-b7b46f2303b7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:39.368501 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-5792f782-aeb5-485d-af45-b7b46f2303b7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef/ips" status: 200 len: 152 microversion: 2.20 time: 0.242046 May 10 21:25:39.369427 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 352/701] 10.222.0.25 () {60 vars in 1288 bytes} [Tue May 10 21:25:39 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef/ips => generated 152 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:25:39.446724 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-02d58a40-a0d4-47d1-aea4-0ec60af58b8e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:39.447987 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-02d58a40-a0d4-47d1-aea4-0ec60af58b8e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 11411cb5-9de1-4ea1-8cdf-e770019076dc] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:39.456428 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-02d58a40-a0d4-47d1-aea4-0ec60af58b8e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:39.457066 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-02d58a40-a0d4-47d1-aea4-0ec60af58b8e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:39.458017 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-02d58a40-a0d4-47d1-aea4-0ec60af58b8e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:39.458469 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-02d58a40-a0d4-47d1-aea4-0ec60af58b8e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:39.501763 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-02d58a40-a0d4-47d1-aea4-0ec60af58b8e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:39.502471 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-02d58a40-a0d4-47d1-aea4-0ec60af58b8e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:39.503074 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.objects.instance [None req-02d58a40-a0d4-47d1-aea4-0ec60af58b8e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lazy-loading 'fault' on Instance uuid 11411cb5-9de1-4ea1-8cdf-e770019076dc {{(pid=117678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:25:39.548947 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-02d58a40-a0d4-47d1-aea4-0ec60af58b8e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:39.562867 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-02d58a40-a0d4-47d1-aea4-0ec60af58b8e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc" status: 200 len: 1331 microversion: 2.1 time: 0.121510 May 10 21:25:39.563593 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 350/702] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:39 2022] GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc => generated 1331 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:40.287521 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-9837512d-09c5-41f5-b8a9-d80c0496edfc tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:40.288125 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-9837512d-09c5-41f5-b8a9-d80c0496edfc tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:40.294581 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9837512d-09c5-41f5-b8a9-d80c0496edfc tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:40.295030 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9837512d-09c5-41f5-b8a9-d80c0496edfc tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:40.295793 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9837512d-09c5-41f5-b8a9-d80c0496edfc tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:40.296224 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9837512d-09c5-41f5-b8a9-d80c0496edfc tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:40.426529 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-9837512d-09c5-41f5-b8a9-d80c0496edfc tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:40.434077 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-9837512d-09c5-41f5-b8a9-d80c0496edfc tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1554 microversion: 2.1 time: 0.150411 May 10 21:25:40.434819 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 353/703] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:40 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:40.581134 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-ad954fda-e52a-465b-836f-dc233a00f1bf tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:40.583955 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-ad954fda-e52a-465b-836f-dc233a00f1bf tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 11411cb5-9de1-4ea1-8cdf-e770019076dc] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:40.591388 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ad954fda-e52a-465b-836f-dc233a00f1bf tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:40.591831 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ad954fda-e52a-465b-836f-dc233a00f1bf tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:40.592596 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ad954fda-e52a-465b-836f-dc233a00f1bf tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:40.593019 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ad954fda-e52a-465b-836f-dc233a00f1bf tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:40.624591 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ad954fda-e52a-465b-836f-dc233a00f1bf tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:40.625052 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ad954fda-e52a-465b-836f-dc233a00f1bf tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:40.625477 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.objects.instance [None req-ad954fda-e52a-465b-836f-dc233a00f1bf tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lazy-loading 'fault' on Instance uuid 11411cb5-9de1-4ea1-8cdf-e770019076dc {{(pid=117678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:25:40.668314 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-ad954fda-e52a-465b-836f-dc233a00f1bf tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:40.675817 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-ad954fda-e52a-465b-836f-dc233a00f1bf tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc" status: 200 len: 1331 microversion: 2.1 time: 0.098446 May 10 21:25:40.676387 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 351/704] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:40 2022] GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:41.451977 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-accaf2e8-0684-42fb-8c2f-61088b76aff6 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:25:41.452557 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-accaf2e8-0684-42fb-8c2f-61088b76aff6 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:41.461424 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-accaf2e8-0684-42fb-8c2f-61088b76aff6 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:41.461424 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-accaf2e8-0684-42fb-8c2f-61088b76aff6 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:41.461723 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-accaf2e8-0684-42fb-8c2f-61088b76aff6 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:41.461989 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-bad3e4b0-5c96-4d23-8842-9a67193770eb tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:41.462158 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-accaf2e8-0684-42fb-8c2f-61088b76aff6 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:41.462974 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-bad3e4b0-5c96-4d23-8842-9a67193770eb tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:41.469763 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-bad3e4b0-5c96-4d23-8842-9a67193770eb tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:41.470469 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-bad3e4b0-5c96-4d23-8842-9a67193770eb tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:41.471412 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-bad3e4b0-5c96-4d23-8842-9a67193770eb tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:41.472008 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-bad3e4b0-5c96-4d23-8842-9a67193770eb tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:41.488697 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.objects.instance [None req-accaf2e8-0684-42fb-8c2f-61088b76aff6 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lazy-loading 'flavor' on Instance uuid f31bca91-29e8-4a4c-ba97-7e4c993502ef {{(pid=117679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:25:41.559512 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-bad3e4b0-5c96-4d23-8842-9a67193770eb tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee2a53cb70b4281bb49e39d70abfaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7858ff72ee9843a493c27f9592a540b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:41.576180 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-bad3e4b0-5c96-4d23-8842-9a67193770eb tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 200 len: 1512 microversion: 2.1 time: 0.119499 May 10 21:25:41.594159 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 352/705] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:41 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 1512 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:41.594159 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-80d387e2-1368-4140-87e9-da4fbed2d1f8 req-ff1bd708-280b-4836-8758-a3b964c8b708 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4f87d15-87fb-4ada-8b58-6fa220505241", "name": "network-vif-deleted", "tag": "00f67420-6c95-4cc5-8544-bceeed674619"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:25:41.594159 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-80d387e2-1368-4140-87e9-da4fbed2d1f8 req-ff1bd708-280b-4836-8758-a3b964c8b708 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:41.594159 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-80d387e2-1368-4140-87e9-da4fbed2d1f8 req-ff1bd708-280b-4836-8758-a3b964c8b708 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:41.600466 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-80d387e2-1368-4140-87e9-da4fbed2d1f8 req-ff1bd708-280b-4836-8758-a3b964c8b708 service nova] Creating event network-vif-deleted:00f67420-6c95-4cc5-8544-bceeed674619 for instance c4f87d15-87fb-4ada-8b58-6fa220505241 on hv-cinder-83608 May 10 21:25:41.605704 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-80d387e2-1368-4140-87e9-da4fbed2d1f8 req-ff1bd708-280b-4836-8758-a3b964c8b708 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027808 May 10 21:25:41.606271 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 353/706] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:25:41.693805 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-fbd17de2-cc88-4119-ad31-01c0d11f2992 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:41.694615 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-fbd17de2-cc88-4119-ad31-01c0d11f2992 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 11411cb5-9de1-4ea1-8cdf-e770019076dc] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:41.703471 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-fbd17de2-cc88-4119-ad31-01c0d11f2992 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:41.703471 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-fbd17de2-cc88-4119-ad31-01c0d11f2992 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:41.703471 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-fbd17de2-cc88-4119-ad31-01c0d11f2992 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:41.703471 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-fbd17de2-cc88-4119-ad31-01c0d11f2992 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:41.716760 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.wsgi [None req-fbd17de2-cc88-4119-ad31-01c0d11f2992 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] HTTP exception thrown: Instance 11411cb5-9de1-4ea1-8cdf-e770019076dc could not be found. May 10 21:25:41.718976 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-fbd17de2-cc88-4119-ad31-01c0d11f2992 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Request method failure captured: May 10 21:25:41.718976 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: request: GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc HTTP/1.1 May 10 21:25:41.718976 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept: application/json May 10 21:25:41.718976 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept-Encoding: identity May 10 21:25:41.718976 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Connection: close May 10 21:25:41.718976 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Length: 0 May 10 21:25:41.718976 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Type: application/json May 10 21:25:41.718976 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Host: 10.222.0.25 May 10 21:25:41.718976 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Openstack-System-Scope: None May 10 21:25:41.718976 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: User-Agent: python-urllib3/1.26.9 May 10 21:25:41.718976 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Auth-Token: gAAAAABietccfViYRiOQpEa4ldvOHZyUgOQ2ZBBatS9SA20GCDt_AgmFvo4vE33WkYc6oqnMaRFSIYJbwKR_AxZ5OfoHdxsDJwPaySjCJQ5rrDhZmJbbtmsjCkN_RYEyYX6qvdoHvFk_bXj7SkSAx705IP0l1sxFz6bBTFTgIB8EAyrOf7pHKV8 May 10 21:25:41.718976 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Id: None May 10 21:25:41.718976 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Name: None May 10 21:25:41.718976 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Identity-Status: Confirmed May 10 21:25:41.718976 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Is-Admin-Project: True May 10 21:25:41.718976 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Id: default May 10 21:25:41.718976 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Name: Default May 10 21:25:41.718976 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Id: 8286226c580f4896aec72c65642fce30 May 10 21:25:41.718976 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Name: tempest-AttachVolumeNegativeTest-1863330069 May 10 21:25:41.718976 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Role: member,reader May 10 21:25:41.718976 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Roles: member,reader May 10 21:25:41.720525 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8286226c580f4896aec72c65642fce30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8286226c580f4896aec72c65642fce30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8286226c580f4896aec72c65642fce30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8286226c580f4896aec72c65642fce30"}]}] May 10 21:25:41.720525 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant: tempest-AttachVolumeNegativeTest-1863330069 May 10 21:25:41.720525 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Id: 8286226c580f4896aec72c65642fce30 May 10 21:25:41.720525 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1863330069 May 10 21:25:41.720525 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User: tempest-AttachVolumeNegativeTest-1863330069-project May 10 21:25:41.720525 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Id: default May 10 21:25:41.720525 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Name: Default May 10 21:25:41.720525 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Id: ca39678abe6e476283f94c675d4ea369 May 10 21:25:41.720525 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Name: tempest-AttachVolumeNegativeTest-1863330069-project May 10 21:25:41.720525 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: method: > May 10 21:25:41.720525 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: exception: Instance 11411cb5-9de1-4ea1-8cdf-e770019076dc could not be found. May 10 21:25:41.720525 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: action_args: {'id': '11411cb5-9de1-4ea1-8cdf-e770019076dc'} May 10 21:25:41.721441 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:25:41.721441 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:41.721441 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:25:41.721441 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:25:41.721441 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:25:41.721441 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:25:41.721441 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:25:41.721441 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:25:41.721441 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:25:41.721441 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:25:41.721441 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11411cb5-9de1-4ea1-8cdf-e770019076dc could not be found. May 10 21:25:41.721441 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:25:41.721441 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:25:41.721441 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:25:41.721441 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:41.721441 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:25:41.721441 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:25:41.721441 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:25:41.721441 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:25:41.721441 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:25:41.722946 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:25:41.722946 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:25:41.722946 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:25:41.722946 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:25:41.722946 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:25:41.722946 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:25:41.722946 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:25:41.722946 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11411cb5-9de1-4ea1-8cdf-e770019076dc could not be found. May 10 21:25:41.722946 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:25:41.722946 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:25:41.722946 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:25:41.722946 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:41.722946 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:25:41.722946 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:25:41.722946 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:25:41.722946 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:25:41.722946 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11411cb5-9de1-4ea1-8cdf-e770019076dc could not be found. May 10 21:25:41.722946 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:25:41.725023 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-fbd17de2-cc88-4119-ad31-01c0d11f2992 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Returning 404 to user: Instance 11411cb5-9de1-4ea1-8cdf-e770019076dc could not be found. {{(pid=117678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:25:41.725886 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-fbd17de2-cc88-4119-ad31-01c0d11f2992 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc" status: 404 len: 111 microversion: 2.1 time: 0.036551 May 10 21:25:41.727027 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 354/707] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:41 2022] GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 21:25:41.735303 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-2d268066-45da-4704-802b-9ac63858fa01 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '.version_select at 0x7f7aea28d9d0>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:41.801536 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-2d268066-45da-4704-802b-9ac63858fa01 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1992666835" status: 202 len: 0 microversion: 2.1 time: 0.069923 May 10 21:25:41.802111 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 355/708] 10.222.0.25 () {58 vars in 1220 bytes} [Tue May 10 21:25:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1992666835 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 21:25:42.169559 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-accaf2e8-0684-42fb-8c2f-61088b76aff6 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "POST /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef/action" status: 202 len: 0 microversion: 2.20 time: 0.722549 May 10 21:25:42.170279 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 354/709] 10.222.0.25 () {62 vars in 1318 bytes} [Tue May 10 21:25:41 2022] POST /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef/action => generated 0 bytes in 724 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 21:25:42.178659 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-ae1ae814-166f-4a2b-9371-6b5594eab88b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:42.179308 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-ae1ae814-166f-4a2b-9371-6b5594eab88b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:42.185922 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ae1ae814-166f-4a2b-9371-6b5594eab88b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:42.186983 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ae1ae814-166f-4a2b-9371-6b5594eab88b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:42.187256 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ae1ae814-166f-4a2b-9371-6b5594eab88b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:42.187685 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ae1ae814-166f-4a2b-9371-6b5594eab88b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:42.358762 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-ae1ae814-166f-4a2b-9371-6b5594eab88b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:42.368001 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-ae1ae814-166f-4a2b-9371-6b5594eab88b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:42.370012 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-ae1ae814-166f-4a2b-9371-6b5594eab88b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:42.371440 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-ae1ae814-166f-4a2b-9371-6b5594eab88b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1724 microversion: 2.20 time: 0.196830 May 10 21:25:42.371993 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 356/710] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:25:42 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:25:42.594202 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a0c5887b-ed1d-43df-b34c-0f7ca38060d9 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:42.594938 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-a0c5887b-ed1d-43df-b34c-0f7ca38060d9 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] [instance: c4f87d15-87fb-4ada-8b58-6fa220505241] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:42.604190 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a0c5887b-ed1d-43df-b34c-0f7ca38060d9 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:42.604651 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a0c5887b-ed1d-43df-b34c-0f7ca38060d9 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:42.605431 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a0c5887b-ed1d-43df-b34c-0f7ca38060d9 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:42.605868 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a0c5887b-ed1d-43df-b34c-0f7ca38060d9 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:42.625307 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-a0c5887b-ed1d-43df-b34c-0f7ca38060d9 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] HTTP exception thrown: Instance c4f87d15-87fb-4ada-8b58-6fa220505241 could not be found. May 10 21:25:42.627651 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a0c5887b-ed1d-43df-b34c-0f7ca38060d9 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Request method failure captured: May 10 21:25:42.627651 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: request: GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 HTTP/1.1 May 10 21:25:42.627651 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept: application/json May 10 21:25:42.627651 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity May 10 21:25:42.627651 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Connection: close May 10 21:25:42.627651 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Length: 0 May 10 21:25:42.627651 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Type: application/json May 10 21:25:42.627651 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Host: 10.222.0.25 May 10 21:25:42.627651 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None May 10 21:25:42.627651 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 May 10 21:25:42.627651 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABietex_-WM0csCd8flplZNjbA0R8f08bJsg3esYE65NjNfizZ59kVs0TQrIvWTL471X5GmajdqIbnLu8olKYFg_WhF7KJaRonaijeGaHWSZt2ZahPWNi1ahDobwjwv6G0PCWbyx37VXTqX9ztYKgN2PJpMmNsARm9QJeq6peLxR0tLssU May 10 21:25:42.627651 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Id: None May 10 21:25:42.627651 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Name: None May 10 21:25:42.627651 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed May 10 21:25:42.627651 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True May 10 21:25:42.627651 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default May 10 21:25:42.627651 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default May 10 21:25:42.627651 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Id: 7858ff72ee9843a493c27f9592a540b0 May 10 21:25:42.627651 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-TestMinimumBasicScenario-1704501838 May 10 21:25:42.627651 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Role: member,reader May 10 21:25:42.627651 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Roles: member,reader May 10 21:25:42.629121 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7858ff72ee9843a493c27f9592a540b0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7858ff72ee9843a493c27f9592a540b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7858ff72ee9843a493c27f9592a540b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7858ff72ee9843a493c27f9592a540b0"}]}] May 10 21:25:42.629121 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-TestMinimumBasicScenario-1704501838 May 10 21:25:42.629121 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Id: 7858ff72ee9843a493c27f9592a540b0 May 10 21:25:42.629121 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1704501838 May 10 21:25:42.629121 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User: tempest-TestMinimumBasicScenario-1704501838-project May 10 21:25:42.629121 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default May 10 21:25:42.629121 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default May 10 21:25:42.629121 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Id: cee2a53cb70b4281bb49e39d70abfaa6 May 10 21:25:42.629121 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-TestMinimumBasicScenario-1704501838-project May 10 21:25:42.629121 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: method: > May 10 21:25:42.629121 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: exception: Instance c4f87d15-87fb-4ada-8b58-6fa220505241 could not be found. May 10 21:25:42.629121 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: action_args: {'id': 'c4f87d15-87fb-4ada-8b58-6fa220505241'} May 10 21:25:42.630005 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:25:42.630005 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:42.630005 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:25:42.630005 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:25:42.630005 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:25:42.630005 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:25:42.630005 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:25:42.630005 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:25:42.630005 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:25:42.630005 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:25:42.630005 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4f87d15-87fb-4ada-8b58-6fa220505241 could not be found. May 10 21:25:42.630005 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:25:42.630005 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:25:42.630005 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:25:42.630005 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:42.630005 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:25:42.630005 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:25:42.630005 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:25:42.630005 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:25:42.630005 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:25:42.631446 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:25:42.631446 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:25:42.631446 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:25:42.631446 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:25:42.631446 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:25:42.631446 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:25:42.631446 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:25:42.631446 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4f87d15-87fb-4ada-8b58-6fa220505241 could not be found. May 10 21:25:42.631446 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:25:42.631446 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:25:42.631446 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:25:42.631446 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:42.631446 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:25:42.631446 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:25:42.631446 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:25:42.631446 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:25:42.631446 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4f87d15-87fb-4ada-8b58-6fa220505241 could not be found. May 10 21:25:42.631446 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:25:42.633291 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a0c5887b-ed1d-43df-b34c-0f7ca38060d9 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Returning 404 to user: Instance c4f87d15-87fb-4ada-8b58-6fa220505241 could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:25:42.633291 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-a0c5887b-ed1d-43df-b34c-0f7ca38060d9 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241" status: 404 len: 111 microversion: 2.1 time: 0.039800 May 10 21:25:42.638882 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-b79f66f1-4237-4150-8c20-19f63bd12892 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] Calling method '.version_select at 0x7f7aea50cdc0>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:42.644287 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 355/711] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:42 2022] GET /compute/v2.1/servers/c4f87d15-87fb-4ada-8b58-6fa220505241 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:25:42.710141 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-b79f66f1-4237-4150-8c20-19f63bd12892 tempest-TestMinimumBasicScenario-1704501838 tempest-TestMinimumBasicScenario-1704501838-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1471037199" status: 202 len: 0 microversion: 2.1 time: 0.075461 May 10 21:25:42.711856 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 357/712] 10.222.0.25 () {58 vars in 1271 bytes} [Tue May 10 21:25:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1471037199 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 21:25:42.753000 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-c42dbd99-9bdc-4cde-8757-d38a28aa78db tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Action: 'create', calling method: .version_select at 0x7f7aef6a4940>, body: {"keypair": {"name": "tempest-keypair-266562216", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAKC+2w6SpVL/N9oRtvvx1l+dKi0UWUv0PqLmK5mIud4/G1n8DNPbmEjN3K9UlE8aR5AWMX+Gf18kgNh51wgkqONAWCnk5KpCVosES91Tn/7l0dPi6gjmbtXLA/uEEIXqw=="}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:25:42.767526 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-c42dbd99-9bdc-4cde-8757-d38a28aa78db tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Getting quotas for project 8286226c580f4896aec72c65642fce30. Resources: {'key_pairs'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:25:42.771256 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-c42dbd99-9bdc-4cde-8757-d38a28aa78db tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Getting quotas for user ca39678abe6e476283f94c675d4ea369 and project 8286226c580f4896aec72c65642fce30. Resources: {'key_pairs'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:25:42.875585 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-c42dbd99-9bdc-4cde-8757-d38a28aa78db tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.126499 May 10 21:25:42.883331 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 356/713] 10.222.0.25 () {60 vars in 1158 bytes} [Tue May 10 21:25:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:25:43.390041 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-b60ef0e9-fa4c-429b-a014-7ea810989a60 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:43.390637 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-b60ef0e9-fa4c-429b-a014-7ea810989a60 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:43.396931 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b60ef0e9-fa4c-429b-a014-7ea810989a60 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:43.397366 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b60ef0e9-fa4c-429b-a014-7ea810989a60 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:43.398675 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b60ef0e9-fa4c-429b-a014-7ea810989a60 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:43.399329 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b60ef0e9-fa4c-429b-a014-7ea810989a60 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:43.803465 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-b60ef0e9-fa4c-429b-a014-7ea810989a60 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:43.813647 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-b60ef0e9-fa4c-429b-a014-7ea810989a60 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:43.828758 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-b60ef0e9-fa4c-429b-a014-7ea810989a60 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:43.828758 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-b60ef0e9-fa4c-429b-a014-7ea810989a60 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1724 microversion: 2.20 time: 0.430644 May 10 21:25:43.828758 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 358/714] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:25:43 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1724 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:25:44.840269 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-436d6e41-1ccb-4574-b46e-f9a20c43e4f7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:44.840708 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-436d6e41-1ccb-4574-b46e-f9a20c43e4f7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:44.865959 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-436d6e41-1ccb-4574-b46e-f9a20c43e4f7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:44.866260 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-436d6e41-1ccb-4574-b46e-f9a20c43e4f7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:44.869415 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-436d6e41-1ccb-4574-b46e-f9a20c43e4f7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:44.869868 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-436d6e41-1ccb-4574-b46e-f9a20c43e4f7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:45.080787 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-436d6e41-1ccb-4574-b46e-f9a20c43e4f7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:45.096994 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-436d6e41-1ccb-4574-b46e-f9a20c43e4f7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:45.099181 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-436d6e41-1ccb-4574-b46e-f9a20c43e4f7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:45.100783 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-436d6e41-1ccb-4574-b46e-f9a20c43e4f7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1724 microversion: 2.20 time: 0.269246 May 10 21:25:45.102362 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 357/715] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:25:44 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1724 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:25:45.577718 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-90ed429d-999e-47b1-9f15-c1ce60e34ccb tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1605178942", "imageRef": "2d72b3e0-7d02-481e-b5e6-17f44e8729d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3f280d19-4e21-4706-a61f-7c29f950ac00"}], "security_groups": [{"name": "tempest-securitygroup--130496001"}], "key_name": "tempest-keypair-266562216", "user_data": "}} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:25:45.684260 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.network.neutron [None req-90ed429d-999e-47b1-9f15-c1ce60e34ccb tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] validate_networks() for [('3f280d19-4e21-4706-a61f-7c29f950ac00', None, None, None, None, None)] {{(pid=117678) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 21:25:46.120352 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-472e065a-795b-46ac-a1a9-5ecf00a320fe tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:46.121742 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-472e065a-795b-46ac-a1a9-5ecf00a320fe tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:46.128539 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-472e065a-795b-46ac-a1a9-5ecf00a320fe tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:46.129220 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-472e065a-795b-46ac-a1a9-5ecf00a320fe tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:46.130150 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-472e065a-795b-46ac-a1a9-5ecf00a320fe tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:46.130759 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-472e065a-795b-46ac-a1a9-5ecf00a320fe tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:46.182621 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-90ed429d-999e-47b1-9f15-c1ce60e34ccb tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Flavor limits 0:0:0 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 21:25:46.183042 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-90ed429d-999e-47b1-9f15-c1ce60e34ccb tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Image limits 0:0:0 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 21:25:46.183649 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-90ed429d-999e-47b1-9f15-c1ce60e34ccb tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Flavor pref 0:0:0 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 21:25:46.184159 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-90ed429d-999e-47b1-9f15-c1ce60e34ccb tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Image pref 0:0:0 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 21:25:46.184938 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-90ed429d-999e-47b1-9f15-c1ce60e34ccb tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 21:25:46.197273 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-90ed429d-999e-47b1-9f15-c1ce60e34ccb tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:46.197994 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-90ed429d-999e-47b1-9f15-c1ce60e34ccb tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:46.198986 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-90ed429d-999e-47b1-9f15-c1ce60e34ccb tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:46.199597 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-90ed429d-999e-47b1-9f15-c1ce60e34ccb tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:46.219655 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.quota [None req-90ed429d-999e-47b1-9f15-c1ce60e34ccb tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Getting quotas for project 8286226c580f4896aec72c65642fce30. Resources: {'cores', 'instances', 'ram'} {{(pid=117678) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:25:46.224417 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.quota [None req-90ed429d-999e-47b1-9f15-c1ce60e34ccb tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Getting quotas for user ca39678abe6e476283f94c675d4ea369 and project 8286226c580f4896aec72c65642fce30. Resources: {'cores', 'instances', 'ram'} {{(pid=117678) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:25:46.239414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-90ed429d-999e-47b1-9f15-c1ce60e34ccb tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Going to run 1 instances... {{(pid=117678) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 21:25:46.242755 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-90ed429d-999e-47b1-9f15-c1ce60e34ccb tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 77e29a35-349a-4aca-a98e-fccec1f7723a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d72b3e0-7d02-481e-b5e6-17f44e8729d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 21:25:46.401157 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-90ed429d-999e-47b1-9f15-c1ce60e34ccb tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.827524 May 10 21:25:46.403896 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 359/716] 10.222.0.25 () {60 vars in 1146 bytes} [Tue May 10 21:25:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 21:25:46.413764 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-d57ed3e8-6672-47b2-a6a4-d9747e6dbe50 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:46.415031 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-d57ed3e8-6672-47b2-a6a4-d9747e6dbe50 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 77e29a35-349a-4aca-a98e-fccec1f7723a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:46.415362 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-472e065a-795b-46ac-a1a9-5ecf00a320fe tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:46.433520 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-472e065a-795b-46ac-a1a9-5ecf00a320fe tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:46.439612 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-472e065a-795b-46ac-a1a9-5ecf00a320fe tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:46.441005 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-472e065a-795b-46ac-a1a9-5ecf00a320fe tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1724 microversion: 2.20 time: 0.324773 May 10 21:25:46.442075 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 358/717] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:25:46 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1724 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:25:46.494062 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-d57ed3e8-6672-47b2-a6a4-d9747e6dbe50 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:46.503824 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-d57ed3e8-6672-47b2-a6a4-d9747e6dbe50 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a" status: 200 len: 1241 microversion: 2.1 time: 0.094148 May 10 21:25:46.504784 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 360/718] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:46 2022] GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a => generated 1241 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:25:47.460660 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-0c0e9268-7a6f-419f-bcbc-590183d1a0bf tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:47.461943 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-0c0e9268-7a6f-419f-bcbc-590183d1a0bf tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:47.474680 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0c0e9268-7a6f-419f-bcbc-590183d1a0bf tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:47.474680 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0c0e9268-7a6f-419f-bcbc-590183d1a0bf tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:47.474863 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0c0e9268-7a6f-419f-bcbc-590183d1a0bf tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:47.475422 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0c0e9268-7a6f-419f-bcbc-590183d1a0bf tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:47.526914 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-7db9672a-67af-4495-a780-78be6ef1b12c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:47.527537 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-7db9672a-67af-4495-a780-78be6ef1b12c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 77e29a35-349a-4aca-a98e-fccec1f7723a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:47.535194 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7db9672a-67af-4495-a780-78be6ef1b12c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:47.535646 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7db9672a-67af-4495-a780-78be6ef1b12c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:47.536430 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7db9672a-67af-4495-a780-78be6ef1b12c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:47.536869 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7db9672a-67af-4495-a780-78be6ef1b12c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:47.615878 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-7db9672a-67af-4495-a780-78be6ef1b12c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:47.628485 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-7db9672a-67af-4495-a780-78be6ef1b12c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a" status: 200 len: 1245 microversion: 2.1 time: 0.106022 May 10 21:25:47.637830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 361/719] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:47 2022] GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a => generated 1245 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:25:47.673082 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-0c0e9268-7a6f-419f-bcbc-590183d1a0bf tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:47.681511 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-0c0e9268-7a6f-419f-bcbc-590183d1a0bf tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:47.683046 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-0c0e9268-7a6f-419f-bcbc-590183d1a0bf tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:47.684204 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-0c0e9268-7a6f-419f-bcbc-590183d1a0bf tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1724 microversion: 2.20 time: 0.227519 May 10 21:25:47.684836 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 359/720] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:25:47 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:25:48.647586 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-47334fa9-037b-4832-b4e5-1d6ce893c270 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:48.649788 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-47334fa9-037b-4832-b4e5-1d6ce893c270 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 77e29a35-349a-4aca-a98e-fccec1f7723a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:48.656238 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-47334fa9-037b-4832-b4e5-1d6ce893c270 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:48.656691 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-47334fa9-037b-4832-b4e5-1d6ce893c270 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:48.657468 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-47334fa9-037b-4832-b4e5-1d6ce893c270 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:48.658206 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-47334fa9-037b-4832-b4e5-1d6ce893c270 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:48.702329 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-7781c858-e44d-432c-8a59-4c1768385a20 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:48.703027 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-7781c858-e44d-432c-8a59-4c1768385a20 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:48.710045 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7781c858-e44d-432c-8a59-4c1768385a20 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:48.712679 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7781c858-e44d-432c-8a59-4c1768385a20 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:48.713908 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7781c858-e44d-432c-8a59-4c1768385a20 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:48.714635 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7781c858-e44d-432c-8a59-4c1768385a20 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:48.736496 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-47334fa9-037b-4832-b4e5-1d6ce893c270 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:48.744463 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-47334fa9-037b-4832-b4e5-1d6ce893c270 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a" status: 200 len: 1301 microversion: 2.1 time: 0.100864 May 10 21:25:48.745040 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 362/721] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:48 2022] GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a => generated 1301 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:49.053667 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-7781c858-e44d-432c-8a59-4c1768385a20 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:49.062424 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-7781c858-e44d-432c-8a59-4c1768385a20 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:49.064333 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-7781c858-e44d-432c-8a59-4c1768385a20 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:49.065498 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-7781c858-e44d-432c-8a59-4c1768385a20 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1724 microversion: 2.20 time: 0.366970 May 10 21:25:49.076463 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 360/722] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:25:48 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1724 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:25:49.761379 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-498a2cdf-a7e1-444f-b459-dcf9056fa5fc tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:49.762084 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-498a2cdf-a7e1-444f-b459-dcf9056fa5fc tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 77e29a35-349a-4aca-a98e-fccec1f7723a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:49.770500 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-498a2cdf-a7e1-444f-b459-dcf9056fa5fc tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:49.770940 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-498a2cdf-a7e1-444f-b459-dcf9056fa5fc tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:49.771713 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-498a2cdf-a7e1-444f-b459-dcf9056fa5fc tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:49.772137 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-498a2cdf-a7e1-444f-b459-dcf9056fa5fc tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:49.836170 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-498a2cdf-a7e1-444f-b459-dcf9056fa5fc tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:49.845147 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-498a2cdf-a7e1-444f-b459-dcf9056fa5fc tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a" status: 200 len: 1299 microversion: 2.1 time: 0.087831 May 10 21:25:49.845771 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 363/723] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:49 2022] GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:50.084525 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-34d79c8d-bbe0-42d2-9370-fc3be77e620a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:50.085277 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-34d79c8d-bbe0-42d2-9370-fc3be77e620a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:50.092884 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-34d79c8d-bbe0-42d2-9370-fc3be77e620a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:50.093448 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-34d79c8d-bbe0-42d2-9370-fc3be77e620a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:50.094320 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-34d79c8d-bbe0-42d2-9370-fc3be77e620a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:50.094973 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-34d79c8d-bbe0-42d2-9370-fc3be77e620a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:50.387351 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-34d79c8d-bbe0-42d2-9370-fc3be77e620a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:50.395328 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-34d79c8d-bbe0-42d2-9370-fc3be77e620a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:50.396919 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-34d79c8d-bbe0-42d2-9370-fc3be77e620a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:50.398791 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-34d79c8d-bbe0-42d2-9370-fc3be77e620a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1724 microversion: 2.20 time: 0.317971 May 10 21:25:50.399417 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 361/724] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:25:50 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1724 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:25:50.869603 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-cb10841d-f9cf-4510-b789-218a98c9a1ba tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:50.870838 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-cb10841d-f9cf-4510-b789-218a98c9a1ba tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 77e29a35-349a-4aca-a98e-fccec1f7723a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:50.877210 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-cb10841d-f9cf-4510-b789-218a98c9a1ba tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:50.877656 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-cb10841d-f9cf-4510-b789-218a98c9a1ba tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:50.878683 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-cb10841d-f9cf-4510-b789-218a98c9a1ba tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:50.879118 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-cb10841d-f9cf-4510-b789-218a98c9a1ba tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:51.020098 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-cb10841d-f9cf-4510-b789-218a98c9a1ba tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:51.029552 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-cb10841d-f9cf-4510-b789-218a98c9a1ba tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a" status: 200 len: 1366 microversion: 2.1 time: 0.170091 May 10 21:25:51.030144 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 364/725] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:50 2022] GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:51.417788 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-7b1858ba-68c3-4f03-859b-12195c60a91e tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:51.422323 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-7b1858ba-68c3-4f03-859b-12195c60a91e tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:51.431806 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7b1858ba-68c3-4f03-859b-12195c60a91e tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:51.432258 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7b1858ba-68c3-4f03-859b-12195c60a91e tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:51.433871 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7b1858ba-68c3-4f03-859b-12195c60a91e tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:51.434319 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7b1858ba-68c3-4f03-859b-12195c60a91e tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:51.754857 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-7b1858ba-68c3-4f03-859b-12195c60a91e tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:51.762977 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-7b1858ba-68c3-4f03-859b-12195c60a91e tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:51.764945 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-7b1858ba-68c3-4f03-859b-12195c60a91e tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:51.766245 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-7b1858ba-68c3-4f03-859b-12195c60a91e tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1724 microversion: 2.20 time: 0.352981 May 10 21:25:51.766908 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 362/726] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:25:51 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1724 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:25:51.969246 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-04fb26bc-9ab5-40dc-9a32-a9e009ae6d3c req-7b1007c3-a7fa-40e8-b6ad-f29e0342e66e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77e29a35-349a-4aca-a98e-fccec1f7723a", "tag": "ed83693c-e120-41e7-b5f7-1f27045a59aa"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:25:51.979307 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-04fb26bc-9ab5-40dc-9a32-a9e009ae6d3c req-7b1007c3-a7fa-40e8-b6ad-f29e0342e66e service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:51.984265 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-04fb26bc-9ab5-40dc-9a32-a9e009ae6d3c req-7b1007c3-a7fa-40e8-b6ad-f29e0342e66e service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:52.001053 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-04fb26bc-9ab5-40dc-9a32-a9e009ae6d3c req-7b1007c3-a7fa-40e8-b6ad-f29e0342e66e service nova] Creating event network-changed:ed83693c-e120-41e7-b5f7-1f27045a59aa for instance 77e29a35-349a-4aca-a98e-fccec1f7723a on hv-cinder-83608 May 10 21:25:52.008034 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-04fb26bc-9ab5-40dc-9a32-a9e009ae6d3c req-7b1007c3-a7fa-40e8-b6ad-f29e0342e66e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043334 May 10 21:25:52.010154 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 365/727] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:25:52.051056 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-263ec333-c963-449f-9ad0-49c2690c0cd9 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:52.051672 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-263ec333-c963-449f-9ad0-49c2690c0cd9 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 77e29a35-349a-4aca-a98e-fccec1f7723a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:52.061467 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-263ec333-c963-449f-9ad0-49c2690c0cd9 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:52.061913 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-263ec333-c963-449f-9ad0-49c2690c0cd9 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:52.062717 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-263ec333-c963-449f-9ad0-49c2690c0cd9 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:52.063145 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-263ec333-c963-449f-9ad0-49c2690c0cd9 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:52.404534 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-263ec333-c963-449f-9ad0-49c2690c0cd9 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:52.412672 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-263ec333-c963-449f-9ad0-49c2690c0cd9 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a" status: 200 len: 1366 microversion: 2.1 time: 0.370223 May 10 21:25:52.421648 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 363/728] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:52 2022] GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a => generated 1366 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:52.785908 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-3c5d6fca-3af7-4277-9238-c1606f7332a8 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:52.786637 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-3c5d6fca-3af7-4277-9238-c1606f7332a8 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:52.792650 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3c5d6fca-3af7-4277-9238-c1606f7332a8 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:52.793101 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3c5d6fca-3af7-4277-9238-c1606f7332a8 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:52.793861 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3c5d6fca-3af7-4277-9238-c1606f7332a8 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:52.794291 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3c5d6fca-3af7-4277-9238-c1606f7332a8 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:52.977746 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-3c5d6fca-3af7-4277-9238-c1606f7332a8 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:52.987368 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-3c5d6fca-3af7-4277-9238-c1606f7332a8 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:52.988867 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-3c5d6fca-3af7-4277-9238-c1606f7332a8 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:52.990101 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-3c5d6fca-3af7-4277-9238-c1606f7332a8 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1724 microversion: 2.20 time: 0.208503 May 10 21:25:52.990673 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 366/729] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:25:52 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:25:53.429994 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-52a78f6e-141b-4448-b2e8-0097c3f183a1 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:53.437045 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-52a78f6e-141b-4448-b2e8-0097c3f183a1 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 77e29a35-349a-4aca-a98e-fccec1f7723a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:53.451872 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-52a78f6e-141b-4448-b2e8-0097c3f183a1 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:53.452201 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-52a78f6e-141b-4448-b2e8-0097c3f183a1 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:53.453126 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-52a78f6e-141b-4448-b2e8-0097c3f183a1 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:53.453559 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-52a78f6e-141b-4448-b2e8-0097c3f183a1 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:53.593244 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-52a78f6e-141b-4448-b2e8-0097c3f183a1 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:53.600893 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-52a78f6e-141b-4448-b2e8-0097c3f183a1 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a" status: 200 len: 1366 microversion: 2.1 time: 0.175431 May 10 21:25:53.602710 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 364/730] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:53 2022] GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:54.010088 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-419a5680-2667-472d-8f7e-9669d3b95faf tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:54.010724 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-419a5680-2667-472d-8f7e-9669d3b95faf tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:54.016926 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-419a5680-2667-472d-8f7e-9669d3b95faf tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:54.017363 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-419a5680-2667-472d-8f7e-9669d3b95faf tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:54.018116 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-419a5680-2667-472d-8f7e-9669d3b95faf tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:54.018563 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-419a5680-2667-472d-8f7e-9669d3b95faf tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:54.261977 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-419a5680-2667-472d-8f7e-9669d3b95faf tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:54.270152 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-419a5680-2667-472d-8f7e-9669d3b95faf tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:54.271828 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-419a5680-2667-472d-8f7e-9669d3b95faf tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:54.274027 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-419a5680-2667-472d-8f7e-9669d3b95faf tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1724 microversion: 2.20 time: 0.267902 May 10 21:25:54.274545 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 367/731] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:25:54 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1724 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:25:54.619000 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6b8407b8-3091-4d4c-acd6-7eef234d5c90 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:54.619612 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-6b8407b8-3091-4d4c-acd6-7eef234d5c90 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 77e29a35-349a-4aca-a98e-fccec1f7723a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:54.628605 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6b8407b8-3091-4d4c-acd6-7eef234d5c90 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:54.629049 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6b8407b8-3091-4d4c-acd6-7eef234d5c90 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:54.629849 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6b8407b8-3091-4d4c-acd6-7eef234d5c90 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:54.630275 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6b8407b8-3091-4d4c-acd6-7eef234d5c90 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:54.769872 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-6b8407b8-3091-4d4c-acd6-7eef234d5c90 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:54.777290 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-6b8407b8-3091-4d4c-acd6-7eef234d5c90 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a" status: 200 len: 1366 microversion: 2.1 time: 0.162921 May 10 21:25:54.777869 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 365/732] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:54 2022] GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:55.294180 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-ec86416c-418d-4056-a0f9-fd73d12695ff tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:55.295498 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-ec86416c-418d-4056-a0f9-fd73d12695ff tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:55.301837 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ec86416c-418d-4056-a0f9-fd73d12695ff tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:55.302286 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ec86416c-418d-4056-a0f9-fd73d12695ff tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:55.303118 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ec86416c-418d-4056-a0f9-fd73d12695ff tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:55.303546 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ec86416c-418d-4056-a0f9-fd73d12695ff tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:55.445730 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-ec86416c-418d-4056-a0f9-fd73d12695ff tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:55.453898 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-ec86416c-418d-4056-a0f9-fd73d12695ff tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:55.455445 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-ec86416c-418d-4056-a0f9-fd73d12695ff tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:55.456594 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-ec86416c-418d-4056-a0f9-fd73d12695ff tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1724 microversion: 2.20 time: 0.167840 May 10 21:25:55.457161 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 368/733] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:25:55 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:25:55.793667 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-48edd63a-a970-4b30-84de-31366a823b93 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:55.794292 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-48edd63a-a970-4b30-84de-31366a823b93 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 77e29a35-349a-4aca-a98e-fccec1f7723a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:55.800637 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-48edd63a-a970-4b30-84de-31366a823b93 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:55.801045 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-48edd63a-a970-4b30-84de-31366a823b93 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:55.801828 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-48edd63a-a970-4b30-84de-31366a823b93 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:55.802229 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-48edd63a-a970-4b30-84de-31366a823b93 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:55.947357 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-48edd63a-a970-4b30-84de-31366a823b93 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:55.954633 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-48edd63a-a970-4b30-84de-31366a823b93 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a" status: 200 len: 1366 microversion: 2.1 time: 0.164848 May 10 21:25:55.955476 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 366/734] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:55 2022] GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:56.475354 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-cb1cb27d-c6a4-4180-bdd2-6d24ee1da9dd tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:56.476225 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-cb1cb27d-c6a4-4180-bdd2-6d24ee1da9dd tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:56.483295 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-cb1cb27d-c6a4-4180-bdd2-6d24ee1da9dd tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:56.483737 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-cb1cb27d-c6a4-4180-bdd2-6d24ee1da9dd tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:56.484497 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-cb1cb27d-c6a4-4180-bdd2-6d24ee1da9dd tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:56.484928 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-cb1cb27d-c6a4-4180-bdd2-6d24ee1da9dd tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:56.614816 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-cb1cb27d-c6a4-4180-bdd2-6d24ee1da9dd tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:56.623197 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-cb1cb27d-c6a4-4180-bdd2-6d24ee1da9dd tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:56.624663 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-cb1cb27d-c6a4-4180-bdd2-6d24ee1da9dd tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:56.625800 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-cb1cb27d-c6a4-4180-bdd2-6d24ee1da9dd tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1724 microversion: 2.20 time: 0.154503 May 10 21:25:56.626368 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 369/735] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:25:56 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:25:56.971525 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-401ae69b-a91d-492d-a56c-e9f483ef5d21 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:56.972130 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-401ae69b-a91d-492d-a56c-e9f483ef5d21 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 77e29a35-349a-4aca-a98e-fccec1f7723a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:56.978658 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-401ae69b-a91d-492d-a56c-e9f483ef5d21 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:56.979103 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-401ae69b-a91d-492d-a56c-e9f483ef5d21 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:56.979861 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-401ae69b-a91d-492d-a56c-e9f483ef5d21 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:56.980291 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-401ae69b-a91d-492d-a56c-e9f483ef5d21 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:57.107739 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-401ae69b-a91d-492d-a56c-e9f483ef5d21 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:57.115004 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-401ae69b-a91d-492d-a56c-e9f483ef5d21 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a" status: 200 len: 1366 microversion: 2.1 time: 0.147349 May 10 21:25:57.115562 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 367/736] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:56 2022] GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:57.644396 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-1f1f7780-3413-4248-96da-bf88977fa56a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:57.645196 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-1f1f7780-3413-4248-96da-bf88977fa56a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:57.652227 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1f1f7780-3413-4248-96da-bf88977fa56a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:57.652666 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1f1f7780-3413-4248-96da-bf88977fa56a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:57.653419 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1f1f7780-3413-4248-96da-bf88977fa56a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:57.653936 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1f1f7780-3413-4248-96da-bf88977fa56a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:57.789829 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-1f1f7780-3413-4248-96da-bf88977fa56a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:57.797931 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-1f1f7780-3413-4248-96da-bf88977fa56a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:57.799471 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-1f1f7780-3413-4248-96da-bf88977fa56a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:57.800619 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-1f1f7780-3413-4248-96da-bf88977fa56a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1724 microversion: 2.20 time: 0.160271 May 10 21:25:57.801181 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 370/737] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:25:57 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:25:58.131333 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-0bc73c95-d8b2-4769-8df5-11dc4099c05e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:58.131937 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-0bc73c95-d8b2-4769-8df5-11dc4099c05e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 77e29a35-349a-4aca-a98e-fccec1f7723a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:58.139386 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0bc73c95-d8b2-4769-8df5-11dc4099c05e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:58.139824 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0bc73c95-d8b2-4769-8df5-11dc4099c05e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:58.140573 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0bc73c95-d8b2-4769-8df5-11dc4099c05e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:58.140996 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0bc73c95-d8b2-4769-8df5-11dc4099c05e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:58.268390 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-0bc73c95-d8b2-4769-8df5-11dc4099c05e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:58.276557 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-0bc73c95-d8b2-4769-8df5-11dc4099c05e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a" status: 200 len: 1366 microversion: 2.1 time: 0.149044 May 10 21:25:58.277127 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 368/738] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:58 2022] GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:58.819354 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-c6ba4fb2-dd6b-4493-9da8-d41c9476fa2c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:58.819927 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-c6ba4fb2-dd6b-4493-9da8-d41c9476fa2c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:58.826470 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c6ba4fb2-dd6b-4493-9da8-d41c9476fa2c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:58.826931 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c6ba4fb2-dd6b-4493-9da8-d41c9476fa2c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:58.827699 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c6ba4fb2-dd6b-4493-9da8-d41c9476fa2c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:58.828138 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c6ba4fb2-dd6b-4493-9da8-d41c9476fa2c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:58.958569 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-c6ba4fb2-dd6b-4493-9da8-d41c9476fa2c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:58.966211 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-c6ba4fb2-dd6b-4493-9da8-d41c9476fa2c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:58.967722 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-c6ba4fb2-dd6b-4493-9da8-d41c9476fa2c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:58.968862 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-c6ba4fb2-dd6b-4493-9da8-d41c9476fa2c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1745 microversion: 2.20 time: 0.153519 May 10 21:25:58.969429 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 371/739] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:25:58 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:25:59.292666 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-f4fda8fd-5e90-4f3e-9619-438856243ab2 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:59.293298 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-f4fda8fd-5e90-4f3e-9619-438856243ab2 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 77e29a35-349a-4aca-a98e-fccec1f7723a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:59.299635 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f4fda8fd-5e90-4f3e-9619-438856243ab2 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:59.300162 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f4fda8fd-5e90-4f3e-9619-438856243ab2 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:59.300944 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f4fda8fd-5e90-4f3e-9619-438856243ab2 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:59.301368 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f4fda8fd-5e90-4f3e-9619-438856243ab2 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:59.432054 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-f4fda8fd-5e90-4f3e-9619-438856243ab2 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:59.439510 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-f4fda8fd-5e90-4f3e-9619-438856243ab2 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a" status: 200 len: 1366 microversion: 2.1 time: 0.150816 May 10 21:25:59.440091 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 369/740] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:25:59 2022] GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:59.794171 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-aece0bfd-791f-49bb-bdbb-c1c6338c9d4b req-0710ee39-f5f4-47bb-8406-f880d4de3b41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77e29a35-349a-4aca-a98e-fccec1f7723a", "name": "network-vif-plugged", "status": "completed", "tag": "ed83693c-e120-41e7-b5f7-1f27045a59aa"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:25:59.802429 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-aece0bfd-791f-49bb-bdbb-c1c6338c9d4b req-0710ee39-f5f4-47bb-8406-f880d4de3b41 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:59.802972 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-aece0bfd-791f-49bb-bdbb-c1c6338c9d4b req-0710ee39-f5f4-47bb-8406-f880d4de3b41 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:59.815105 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-aece0bfd-791f-49bb-bdbb-c1c6338c9d4b req-0710ee39-f5f4-47bb-8406-f880d4de3b41 service nova] Creating event network-vif-plugged:ed83693c-e120-41e7-b5f7-1f27045a59aa for instance 77e29a35-349a-4aca-a98e-fccec1f7723a on hv-cinder-83608 May 10 21:25:59.820022 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-aece0bfd-791f-49bb-bdbb-c1c6338c9d4b req-0710ee39-f5f4-47bb-8406-f880d4de3b41 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206886 May 10 21:25:59.821041 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 372/741] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:25:59.987960 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-00c06ee4-30f1-42ff-ad29-5b7a2c7e53e3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:59.988561 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-00c06ee4-30f1-42ff-ad29-5b7a2c7e53e3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:59.995350 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-00c06ee4-30f1-42ff-ad29-5b7a2c7e53e3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:59.995790 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-00c06ee4-30f1-42ff-ad29-5b7a2c7e53e3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:59.996538 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-00c06ee4-30f1-42ff-ad29-5b7a2c7e53e3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:59.996963 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-00c06ee4-30f1-42ff-ad29-5b7a2c7e53e3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:00.169212 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-00c06ee4-30f1-42ff-ad29-5b7a2c7e53e3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:00.176990 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-00c06ee4-30f1-42ff-ad29-5b7a2c7e53e3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:00.178537 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-00c06ee4-30f1-42ff-ad29-5b7a2c7e53e3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:00.180313 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-00c06ee4-30f1-42ff-ad29-5b7a2c7e53e3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1745 microversion: 2.20 time: 0.196179 May 10 21:26:00.180875 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 370/742] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:25:59 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1745 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:26:00.458089 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-eee27927-82b0-4324-af64-3667448336a1 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:00.458818 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-eee27927-82b0-4324-af64-3667448336a1 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 77e29a35-349a-4aca-a98e-fccec1f7723a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:00.465821 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-eee27927-82b0-4324-af64-3667448336a1 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:00.466266 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-eee27927-82b0-4324-af64-3667448336a1 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:00.467071 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-eee27927-82b0-4324-af64-3667448336a1 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:00.467504 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-eee27927-82b0-4324-af64-3667448336a1 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:00.598428 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-eee27927-82b0-4324-af64-3667448336a1 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:00.605814 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-eee27927-82b0-4324-af64-3667448336a1 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a" status: 200 len: 1366 microversion: 2.1 time: 0.152410 May 10 21:26:00.606371 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 373/743] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:26:00 2022] GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:26:01.198693 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e6f22202-63e1-453c-a7a1-046e871cf309 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:01.199316 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-e6f22202-63e1-453c-a7a1-046e871cf309 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:01.205527 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e6f22202-63e1-453c-a7a1-046e871cf309 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:01.205978 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e6f22202-63e1-453c-a7a1-046e871cf309 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:01.206855 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e6f22202-63e1-453c-a7a1-046e871cf309 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:01.207288 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e6f22202-63e1-453c-a7a1-046e871cf309 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:01.347220 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-e6f22202-63e1-453c-a7a1-046e871cf309 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:01.355478 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-e6f22202-63e1-453c-a7a1-046e871cf309 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:01.356974 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-e6f22202-63e1-453c-a7a1-046e871cf309 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:01.358132 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-e6f22202-63e1-453c-a7a1-046e871cf309 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1740 microversion: 2.20 time: 0.163826 May 10 21:26:01.358738 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 371/744] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:26:01 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:26:01.623696 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-0cd3f53b-652e-4fdb-b0fe-66804cba2bfc tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:01.624518 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-0cd3f53b-652e-4fdb-b0fe-66804cba2bfc tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 77e29a35-349a-4aca-a98e-fccec1f7723a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:01.631547 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0cd3f53b-652e-4fdb-b0fe-66804cba2bfc tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:01.632165 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0cd3f53b-652e-4fdb-b0fe-66804cba2bfc tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:01.633588 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0cd3f53b-652e-4fdb-b0fe-66804cba2bfc tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:01.634185 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0cd3f53b-652e-4fdb-b0fe-66804cba2bfc tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:01.801282 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-0cd3f53b-652e-4fdb-b0fe-66804cba2bfc tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:01.809511 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-0cd3f53b-652e-4fdb-b0fe-66804cba2bfc tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a" status: 200 len: 1556 microversion: 2.1 time: 0.189557 May 10 21:26:01.810878 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 374/745] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:26:01 2022] GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a => generated 1556 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:26:01.833262 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-0141bf4a-fa06-4501-a662-4e7fc7ed9e1d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:01.835305 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-0141bf4a-fa06-4501-a662-4e7fc7ed9e1d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 77e29a35-349a-4aca-a98e-fccec1f7723a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:01.854020 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-6314b304-e880-4533-a933-7892f1b99b62 req-cc2a528d-f3fb-48e3-bc77-cf0c27da2089 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f31bca91-29e8-4a4c-ba97-7e4c993502ef", "name": "network-vif-plugged", "status": "completed", "tag": "53eb87d9-7496-49b6-b83d-932f96780089"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:26:01.865424 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0141bf4a-fa06-4501-a662-4e7fc7ed9e1d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:01.872426 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0141bf4a-fa06-4501-a662-4e7fc7ed9e1d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:01.873308 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0141bf4a-fa06-4501-a662-4e7fc7ed9e1d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:01.873742 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0141bf4a-fa06-4501-a662-4e7fc7ed9e1d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:01.875151 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-6314b304-e880-4533-a933-7892f1b99b62 req-cc2a528d-f3fb-48e3-bc77-cf0c27da2089 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:01.875876 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-6314b304-e880-4533-a933-7892f1b99b62 req-cc2a528d-f3fb-48e3-bc77-cf0c27da2089 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:01.889979 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-6314b304-e880-4533-a933-7892f1b99b62 req-cc2a528d-f3fb-48e3-bc77-cf0c27da2089 service nova] Creating event network-vif-plugged:53eb87d9-7496-49b6-b83d-932f96780089 for instance f31bca91-29e8-4a4c-ba97-7e4c993502ef on hv-cinder-83608 May 10 21:26:01.895915 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-6314b304-e880-4533-a933-7892f1b99b62 req-cc2a528d-f3fb-48e3-bc77-cf0c27da2089 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050457 May 10 21:26:01.897012 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 375/746] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:26:01.971232 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-0141bf4a-fa06-4501-a662-4e7fc7ed9e1d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.147820 May 10 21:26:01.980380 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 372/747] 10.222.0.25 () {58 vars in 1274 bytes} [Tue May 10 21:26:01 2022] GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a/os-interface => generated 284 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:26:02.377652 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-cab388c7-03ff-447b-8bd7-a0b390165840 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:02.378346 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-cab388c7-03ff-447b-8bd7-a0b390165840 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:02.386074 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-cab388c7-03ff-447b-8bd7-a0b390165840 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:02.386823 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-cab388c7-03ff-447b-8bd7-a0b390165840 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:02.387788 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-cab388c7-03ff-447b-8bd7-a0b390165840 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:02.388381 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-cab388c7-03ff-447b-8bd7-a0b390165840 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:02.542326 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-cab388c7-03ff-447b-8bd7-a0b390165840 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:02.550851 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-cab388c7-03ff-447b-8bd7-a0b390165840 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:02.553427 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-cab388c7-03ff-447b-8bd7-a0b390165840 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:02.553713 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-cab388c7-03ff-447b-8bd7-a0b390165840 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1740 microversion: 2.20 time: 0.180242 May 10 21:26:02.554220 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 376/748] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:26:02 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:26:03.379180 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-4bebf8ac-d888-449e-8ed3-7a9aaeb6a841 req-eb4b130e-0a37-4590-9224-7b5555724105 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77e29a35-349a-4aca-a98e-fccec1f7723a", "tag": "ed83693c-e120-41e7-b5f7-1f27045a59aa"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:26:03.389083 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-4bebf8ac-d888-449e-8ed3-7a9aaeb6a841 req-eb4b130e-0a37-4590-9224-7b5555724105 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:03.389650 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-4bebf8ac-d888-449e-8ed3-7a9aaeb6a841 req-eb4b130e-0a37-4590-9224-7b5555724105 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:03.402190 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-4bebf8ac-d888-449e-8ed3-7a9aaeb6a841 req-eb4b130e-0a37-4590-9224-7b5555724105 service nova] Creating event network-changed:ed83693c-e120-41e7-b5f7-1f27045a59aa for instance 77e29a35-349a-4aca-a98e-fccec1f7723a on hv-cinder-83608 May 10 21:26:03.409834 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-4bebf8ac-d888-449e-8ed3-7a9aaeb6a841 req-eb4b130e-0a37-4590-9224-7b5555724105 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111919 May 10 21:26:03.410908 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 373/749] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:26:03.572939 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-8d58fed7-fc9d-43da-8112-c75a3cb84fc0 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:03.573661 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-8d58fed7-fc9d-43da-8112-c75a3cb84fc0 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:03.584917 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8d58fed7-fc9d-43da-8112-c75a3cb84fc0 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:03.585560 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8d58fed7-fc9d-43da-8112-c75a3cb84fc0 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:03.599601 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8d58fed7-fc9d-43da-8112-c75a3cb84fc0 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:03.602923 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8d58fed7-fc9d-43da-8112-c75a3cb84fc0 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:03.820860 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-8d58fed7-fc9d-43da-8112-c75a3cb84fc0 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:03.835472 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-8d58fed7-fc9d-43da-8112-c75a3cb84fc0 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:03.857668 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-8d58fed7-fc9d-43da-8112-c75a3cb84fc0 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:03.859039 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-8d58fed7-fc9d-43da-8112-c75a3cb84fc0 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1740 microversion: 2.20 time: 0.290705 May 10 21:26:03.859948 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 377/750] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:26:03 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1740 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:26:04.877732 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-9ac61130-384b-476b-bbc4-8606b66fb1b2 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:04.878425 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-9ac61130-384b-476b-bbc4-8606b66fb1b2 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:04.885290 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9ac61130-384b-476b-bbc4-8606b66fb1b2 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:04.885723 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9ac61130-384b-476b-bbc4-8606b66fb1b2 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:04.886564 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9ac61130-384b-476b-bbc4-8606b66fb1b2 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:04.886992 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9ac61130-384b-476b-bbc4-8606b66fb1b2 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:05.032847 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-9ac61130-384b-476b-bbc4-8606b66fb1b2 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:05.041502 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-9ac61130-384b-476b-bbc4-8606b66fb1b2 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:05.043036 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-9ac61130-384b-476b-bbc4-8606b66fb1b2 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:05.044204 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-9ac61130-384b-476b-bbc4-8606b66fb1b2 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1740 microversion: 2.20 time: 0.170766 May 10 21:26:05.044790 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 374/751] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:26:04 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:26:06.063175 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-0377d534-9cd1-4fd2-8dcd-bdbc7c0bd399 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:06.064441 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-0377d534-9cd1-4fd2-8dcd-bdbc7c0bd399 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:06.072018 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0377d534-9cd1-4fd2-8dcd-bdbc7c0bd399 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:06.072469 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0377d534-9cd1-4fd2-8dcd-bdbc7c0bd399 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:06.073249 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0377d534-9cd1-4fd2-8dcd-bdbc7c0bd399 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:06.073691 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0377d534-9cd1-4fd2-8dcd-bdbc7c0bd399 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:06.228132 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-0377d534-9cd1-4fd2-8dcd-bdbc7c0bd399 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:06.238674 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-0377d534-9cd1-4fd2-8dcd-bdbc7c0bd399 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:06.239586 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-0377d534-9cd1-4fd2-8dcd-bdbc7c0bd399 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:06.240964 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-0377d534-9cd1-4fd2-8dcd-bdbc7c0bd399 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1740 microversion: 2.20 time: 0.181729 May 10 21:26:06.241543 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 378/752] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:26:06 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:26:07.261779 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-9359e48a-8115-42e5-86f1-cd675d8f07de tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:07.263408 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-9359e48a-8115-42e5-86f1-cd675d8f07de tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:07.270701 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9359e48a-8115-42e5-86f1-cd675d8f07de tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:07.276042 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9359e48a-8115-42e5-86f1-cd675d8f07de tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:07.276042 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9359e48a-8115-42e5-86f1-cd675d8f07de tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:07.276042 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9359e48a-8115-42e5-86f1-cd675d8f07de tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:07.483387 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-9359e48a-8115-42e5-86f1-cd675d8f07de tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:07.493605 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-9359e48a-8115-42e5-86f1-cd675d8f07de tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:07.495325 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-9359e48a-8115-42e5-86f1-cd675d8f07de tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:07.496757 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-9359e48a-8115-42e5-86f1-cd675d8f07de tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1740 microversion: 2.20 time: 0.240589 May 10 21:26:07.508749 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 375/753] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:26:07 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1740 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:26:08.516799 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-8f8ba948-921e-40cb-9231-0d86816349d9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:08.518632 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-8f8ba948-921e-40cb-9231-0d86816349d9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:08.533924 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8f8ba948-921e-40cb-9231-0d86816349d9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:08.535240 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8f8ba948-921e-40cb-9231-0d86816349d9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:08.536227 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8f8ba948-921e-40cb-9231-0d86816349d9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:08.536908 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8f8ba948-921e-40cb-9231-0d86816349d9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:08.723929 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-8f8ba948-921e-40cb-9231-0d86816349d9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:08.735520 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-8f8ba948-921e-40cb-9231-0d86816349d9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:08.737376 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-8f8ba948-921e-40cb-9231-0d86816349d9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:08.738863 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-8f8ba948-921e-40cb-9231-0d86816349d9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1740 microversion: 2.20 time: 0.226133 May 10 21:26:08.750626 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 379/754] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:26:08 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1740 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:26:09.340920 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a1a2edd7-06ae-4708-8b35-04ae0c106df1 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:09.347806 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-a1a2edd7-06ae-4708-8b35-04ae0c106df1 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: 5141f323-2d73-494e-a167-49a618d1f67a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:09.348218 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a1a2edd7-06ae-4708-8b35-04ae0c106df1 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:09.348707 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a1a2edd7-06ae-4708-8b35-04ae0c106df1 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:09.349705 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a1a2edd7-06ae-4708-8b35-04ae0c106df1 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:09.350199 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a1a2edd7-06ae-4708-8b35-04ae0c106df1 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:09.379188 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-a1a2edd7-06ae-4708-8b35-04ae0c106df1 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a/ips" status: 200 len: 145 microversion: 2.1 time: 0.046261 May 10 21:26:09.386083 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 376/755] 10.222.0.25 () {58 vars in 1247 bytes} [Tue May 10 21:26:09 2022] GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a/ips => generated 145 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:26:09.757119 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-645bf467-22d6-45e6-afe5-0bc1b35ecca7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:09.757723 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-645bf467-22d6-45e6-afe5-0bc1b35ecca7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:09.768985 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-645bf467-22d6-45e6-afe5-0bc1b35ecca7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:09.769222 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-645bf467-22d6-45e6-afe5-0bc1b35ecca7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:09.771396 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-645bf467-22d6-45e6-afe5-0bc1b35ecca7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:09.771667 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-645bf467-22d6-45e6-afe5-0bc1b35ecca7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:09.927094 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-645bf467-22d6-45e6-afe5-0bc1b35ecca7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:09.938473 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-645bf467-22d6-45e6-afe5-0bc1b35ecca7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:09.939987 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-645bf467-22d6-45e6-afe5-0bc1b35ecca7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:09.941148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-645bf467-22d6-45e6-afe5-0bc1b35ecca7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1740 microversion: 2.20 time: 0.187940 May 10 21:26:09.941712 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 380/756] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:26:09 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:26:10.960430 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-784a8429-34ef-4edb-8889-d8555e274cdd tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:10.961073 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-784a8429-34ef-4edb-8889-d8555e274cdd tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:10.968748 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-784a8429-34ef-4edb-8889-d8555e274cdd tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:10.969293 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-784a8429-34ef-4edb-8889-d8555e274cdd tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:10.969980 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-784a8429-34ef-4edb-8889-d8555e274cdd tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:10.970411 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-784a8429-34ef-4edb-8889-d8555e274cdd tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:11.089547 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-78459fcd-314d-4dde-89e6-54b7afa91869 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2c1c215-ee09-44bd-a52d-1bf3c066fa9a"}} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:26:11.090714 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-78459fcd-314d-4dde-89e6-54b7afa91869 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: 5141f323-2d73-494e-a167-49a618d1f67a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:11.097938 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-78459fcd-314d-4dde-89e6-54b7afa91869 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:11.098330 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-78459fcd-314d-4dde-89e6-54b7afa91869 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:11.099139 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-78459fcd-314d-4dde-89e6-54b7afa91869 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:11.099580 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-78459fcd-314d-4dde-89e6-54b7afa91869 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:11.125607 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-784a8429-34ef-4edb-8889-d8555e274cdd tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:11.137376 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-784a8429-34ef-4edb-8889-d8555e274cdd tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:11.139259 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-784a8429-34ef-4edb-8889-d8555e274cdd tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:11.140704 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-784a8429-34ef-4edb-8889-d8555e274cdd tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1740 microversion: 2.20 time: 0.184213 May 10 21:26:11.141280 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 377/757] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:26:10 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:26:11.847301 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-78459fcd-314d-4dde-89e6-54b7afa91869 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "POST /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.761236 May 10 21:26:11.848715 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 381/758] 10.222.0.25 () {60 vars in 1322 bytes} [Tue May 10 21:26:11 2022] POST /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a/os-volume_attachments => generated 194 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:26:12.160794 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-09bd5dcd-bb90-4ca4-9808-f798c492db9a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:12.161536 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-09bd5dcd-bb90-4ca4-9808-f798c492db9a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:12.168429 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-09bd5dcd-bb90-4ca4-9808-f798c492db9a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:12.168877 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-09bd5dcd-bb90-4ca4-9808-f798c492db9a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:12.169643 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-09bd5dcd-bb90-4ca4-9808-f798c492db9a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:12.170077 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-09bd5dcd-bb90-4ca4-9808-f798c492db9a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:12.300921 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-09bd5dcd-bb90-4ca4-9808-f798c492db9a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:12.310922 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-09bd5dcd-bb90-4ca4-9808-f798c492db9a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:12.312507 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-09bd5dcd-bb90-4ca4-9808-f798c492db9a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:12.313766 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-09bd5dcd-bb90-4ca4-9808-f798c492db9a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1740 microversion: 2.20 time: 0.156898 May 10 21:26:12.314395 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 378/759] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:26:12 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1740 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:26:13.333693 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-374d9bbb-131d-4175-88bc-b4be11c3fae4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:13.334382 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-374d9bbb-131d-4175-88bc-b4be11c3fae4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:13.341112 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-374d9bbb-131d-4175-88bc-b4be11c3fae4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:13.341549 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-374d9bbb-131d-4175-88bc-b4be11c3fae4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:13.342299 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-374d9bbb-131d-4175-88bc-b4be11c3fae4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:13.342749 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-374d9bbb-131d-4175-88bc-b4be11c3fae4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:13.470099 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-374d9bbb-131d-4175-88bc-b4be11c3fae4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:13.477880 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-374d9bbb-131d-4175-88bc-b4be11c3fae4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:13.479392 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-374d9bbb-131d-4175-88bc-b4be11c3fae4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:13.480529 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-374d9bbb-131d-4175-88bc-b4be11c3fae4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1740 microversion: 2.20 time: 0.151125 May 10 21:26:13.481086 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 382/760] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:26:13 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1740 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:26:14.499276 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-bb2b7950-b36c-4dd4-9bb5-17206bda1066 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:14.500089 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-bb2b7950-b36c-4dd4-9bb5-17206bda1066 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:14.506807 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bb2b7950-b36c-4dd4-9bb5-17206bda1066 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:14.507246 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bb2b7950-b36c-4dd4-9bb5-17206bda1066 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:14.508015 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bb2b7950-b36c-4dd4-9bb5-17206bda1066 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:14.509104 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bb2b7950-b36c-4dd4-9bb5-17206bda1066 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:14.653101 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-bb2b7950-b36c-4dd4-9bb5-17206bda1066 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:14.660903 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-bb2b7950-b36c-4dd4-9bb5-17206bda1066 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:14.662404 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-bb2b7950-b36c-4dd4-9bb5-17206bda1066 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:14.663578 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-bb2b7950-b36c-4dd4-9bb5-17206bda1066 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1740 microversion: 2.20 time: 0.168948 May 10 21:26:14.664138 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 379/761] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:26:14 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1740 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:26:15.682819 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-1258d0ca-a70b-4af5-9a0a-ea6a0c14fe11 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:15.683417 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-1258d0ca-a70b-4af5-9a0a-ea6a0c14fe11 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:15.690280 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1258d0ca-a70b-4af5-9a0a-ea6a0c14fe11 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:15.690756 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1258d0ca-a70b-4af5-9a0a-ea6a0c14fe11 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:15.691622 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1258d0ca-a70b-4af5-9a0a-ea6a0c14fe11 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:15.692092 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1258d0ca-a70b-4af5-9a0a-ea6a0c14fe11 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:15.829150 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-1258d0ca-a70b-4af5-9a0a-ea6a0c14fe11 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:15.839951 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-1258d0ca-a70b-4af5-9a0a-ea6a0c14fe11 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:15.839951 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-1258d0ca-a70b-4af5-9a0a-ea6a0c14fe11 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:15.840965 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-1258d0ca-a70b-4af5-9a0a-ea6a0c14fe11 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1722 microversion: 2.20 time: 0.162230 May 10 21:26:15.841735 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 383/762] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:26:15 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:16.865069 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-2a32c264-f655-4b7f-a9fa-962667b3788c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:16.865677 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-2a32c264-f655-4b7f-a9fa-962667b3788c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:16.872426 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2a32c264-f655-4b7f-a9fa-962667b3788c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:16.872869 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2a32c264-f655-4b7f-a9fa-962667b3788c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:16.873628 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2a32c264-f655-4b7f-a9fa-962667b3788c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:16.874058 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2a32c264-f655-4b7f-a9fa-962667b3788c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:16.999921 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2a32c264-f655-4b7f-a9fa-962667b3788c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:17.007549 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2a32c264-f655-4b7f-a9fa-962667b3788c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:17.009586 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2a32c264-f655-4b7f-a9fa-962667b3788c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:17.011002 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-2a32c264-f655-4b7f-a9fa-962667b3788c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1722 microversion: 2.20 time: 0.149829 May 10 21:26:17.011554 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 380/763] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:26:16 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:26:18.029644 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-9db6e904-0dc7-4cb4-9afb-470582f49deb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:18.030263 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-9db6e904-0dc7-4cb4-9afb-470582f49deb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:18.036567 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9db6e904-0dc7-4cb4-9afb-470582f49deb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:18.037005 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9db6e904-0dc7-4cb4-9afb-470582f49deb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:18.037752 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9db6e904-0dc7-4cb4-9afb-470582f49deb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:18.038177 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9db6e904-0dc7-4cb4-9afb-470582f49deb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:18.165310 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-9db6e904-0dc7-4cb4-9afb-470582f49deb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:18.173051 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-9db6e904-0dc7-4cb4-9afb-470582f49deb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:18.174576 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-9db6e904-0dc7-4cb4-9afb-470582f49deb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:18.175753 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-9db6e904-0dc7-4cb4-9afb-470582f49deb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1722 microversion: 2.20 time: 0.149989 May 10 21:26:18.176321 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 384/764] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:26:18 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:26:19.193121 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-96390b27-d102-4fb3-b4a5-c2822c7c4d9a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:19.194015 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-96390b27-d102-4fb3-b4a5-c2822c7c4d9a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:19.201054 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-96390b27-d102-4fb3-b4a5-c2822c7c4d9a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:19.201502 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-96390b27-d102-4fb3-b4a5-c2822c7c4d9a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:19.202285 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-96390b27-d102-4fb3-b4a5-c2822c7c4d9a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:19.202760 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-96390b27-d102-4fb3-b4a5-c2822c7c4d9a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:19.400391 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-96390b27-d102-4fb3-b4a5-c2822c7c4d9a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:19.409121 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-96390b27-d102-4fb3-b4a5-c2822c7c4d9a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:19.410735 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-96390b27-d102-4fb3-b4a5-c2822c7c4d9a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:19.417279 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-96390b27-d102-4fb3-b4a5-c2822c7c4d9a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1722 microversion: 2.20 time: 0.222744 May 10 21:26:19.417279 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 381/765] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:26:19 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:26:19.503793 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-9b163730-3e6d-4417-bd0f-afb0bfecc496 req-9c1d43ba-8219-4f77-90fe-b15685b65200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f31bca91-29e8-4a4c-ba97-7e4c993502ef", "name": "network-vif-unplugged", "status": "completed", "tag": "53eb87d9-7496-49b6-b83d-932f96780089"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:26:19.513585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-9b163730-3e6d-4417-bd0f-afb0bfecc496 req-9c1d43ba-8219-4f77-90fe-b15685b65200 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:19.516436 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-9b163730-3e6d-4417-bd0f-afb0bfecc496 req-9c1d43ba-8219-4f77-90fe-b15685b65200 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:19.527175 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-9b163730-3e6d-4417-bd0f-afb0bfecc496 req-9c1d43ba-8219-4f77-90fe-b15685b65200 service nova] Creating event network-vif-unplugged:53eb87d9-7496-49b6-b83d-932f96780089 for instance f31bca91-29e8-4a4c-ba97-7e4c993502ef on hv-cinder-83608 May 10 21:26:19.532093 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-9b163730-3e6d-4417-bd0f-afb0bfecc496 req-9c1d43ba-8219-4f77-90fe-b15685b65200 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031983 May 10 21:26:19.532682 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 385/766] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:26:20.430783 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-7c034825-db9c-4b19-b0d5-0a642ef5870b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:20.431532 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-7c034825-db9c-4b19-b0d5-0a642ef5870b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:20.437915 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7c034825-db9c-4b19-b0d5-0a642ef5870b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:20.438364 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7c034825-db9c-4b19-b0d5-0a642ef5870b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:20.439232 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7c034825-db9c-4b19-b0d5-0a642ef5870b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:20.439668 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7c034825-db9c-4b19-b0d5-0a642ef5870b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:20.570570 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-7c034825-db9c-4b19-b0d5-0a642ef5870b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:20.579119 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-7c034825-db9c-4b19-b0d5-0a642ef5870b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:20.580628 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-7c034825-db9c-4b19-b0d5-0a642ef5870b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:20.581791 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-7c034825-db9c-4b19-b0d5-0a642ef5870b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1665 microversion: 2.20 time: 0.154960 May 10 21:26:20.582361 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 382/767] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:26:20 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1665 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:26:20.600967 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-7ed441d8-6dcd-4956-8459-a1a6cbd6443b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0bc172f-cf39-4656-bc9e-eb00552e2aef"}} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:26:20.602453 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-7ed441d8-6dcd-4956-8459-a1a6cbd6443b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:20.609471 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7ed441d8-6dcd-4956-8459-a1a6cbd6443b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:20.609912 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7ed441d8-6dcd-4956-8459-a1a6cbd6443b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:20.610683 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7ed441d8-6dcd-4956-8459-a1a6cbd6443b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:20.611108 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7ed441d8-6dcd-4956-8459-a1a6cbd6443b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:21.799755 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-7ed441d8-6dcd-4956-8459-a1a6cbd6443b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "POST /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.203164 May 10 21:26:21.800390 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 386/768] 10.222.0.25 () {62 vars in 1363 bytes} [Tue May 10 21:26:20 2022] POST /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef/os-volume_attachments => generated 188 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:26:21.913733 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-5892ccdb-af8c-4db6-a5e8-7db1fada251c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:21.914228 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-5892ccdb-af8c-4db6-a5e8-7db1fada251c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:21.921278 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5892ccdb-af8c-4db6-a5e8-7db1fada251c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:21.921723 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5892ccdb-af8c-4db6-a5e8-7db1fada251c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:21.922514 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5892ccdb-af8c-4db6-a5e8-7db1fada251c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:21.922950 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5892ccdb-af8c-4db6-a5e8-7db1fada251c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:22.410811 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-5892ccdb-af8c-4db6-a5e8-7db1fada251c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef/os-volume_attachments/a0bc172f-cf39-4656-bc9e-eb00552e2aef" status: 202 len: 0 microversion: 2.20 time: 0.500962 May 10 21:26:22.411453 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 383/769] 10.222.0.25 () {60 vars in 1456 bytes} [Tue May 10 21:26:21 2022] DELETE /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef/os-volume_attachments/a0bc172f-cf39-4656-bc9e-eb00552e2aef => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 10 21:26:22.467817 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-39719493-0971-4a50-ab43-23b0eabe6cf3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:26:22.468386 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-39719493-0971-4a50-ab43-23b0eabe6cf3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:22.475419 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-39719493-0971-4a50-ab43-23b0eabe6cf3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:22.475871 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-39719493-0971-4a50-ab43-23b0eabe6cf3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:22.476645 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-39719493-0971-4a50-ab43-23b0eabe6cf3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:22.477083 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-39719493-0971-4a50-ab43-23b0eabe6cf3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:22.542300 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4c146606-0cec-4b29-87cb-318dba2dcf9d tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:22.543405 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-4c146606-0cec-4b29-87cb-318dba2dcf9d tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: 5141f323-2d73-494e-a167-49a618d1f67a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:22.550429 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4c146606-0cec-4b29-87cb-318dba2dcf9d tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:22.550990 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4c146606-0cec-4b29-87cb-318dba2dcf9d tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:22.551840 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4c146606-0cec-4b29-87cb-318dba2dcf9d tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:22.552330 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4c146606-0cec-4b29-87cb-318dba2dcf9d tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:22.584070 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4c146606-0cec-4b29-87cb-318dba2dcf9d tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051107 May 10 21:26:22.584637 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 384/770] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 10 21:26:22 2022] GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:26:22.594723 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a33fd3a7-fe9d-4f32-b7f9-c145356bfdb9 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:22.595208 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-a33fd3a7-fe9d-4f32-b7f9-c145356bfdb9 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: 5141f323-2d73-494e-a167-49a618d1f67a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:22.600846 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a33fd3a7-fe9d-4f32-b7f9-c145356bfdb9 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:22.601295 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a33fd3a7-fe9d-4f32-b7f9-c145356bfdb9 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:22.602049 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a33fd3a7-fe9d-4f32-b7f9-c145356bfdb9 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:22.602620 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a33fd3a7-fe9d-4f32-b7f9-c145356bfdb9 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:22.631650 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-a33fd3a7-fe9d-4f32-b7f9-c145356bfdb9 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a/os-volume_attachments/c2c1c215-ee09-44bd-a52d-1bf3c066fa9a" status: 200 len: 194 microversion: 2.1 time: 0.040769 May 10 21:26:22.633322 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 385/771] 10.222.0.25 () {58 vars in 1412 bytes} [Tue May 10 21:26:22 2022] GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a/os-volume_attachments/c2c1c215-ee09-44bd-a52d-1bf3c066fa9a => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:26:22.734119 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-39719493-0971-4a50-ab43-23b0eabe6cf3 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "POST /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef/action" status: 202 len: 0 microversion: 2.20 time: 0.270277 May 10 21:26:22.735212 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 387/772] 10.222.0.25 () {62 vars in 1318 bytes} [Tue May 10 21:26:22 2022] POST /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 21:26:22.749747 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-9addd1ff-4e0f-4329-a6ea-208d0e7b995c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:22.750359 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-9addd1ff-4e0f-4329-a6ea-208d0e7b995c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:22.757018 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9addd1ff-4e0f-4329-a6ea-208d0e7b995c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:22.757320 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9addd1ff-4e0f-4329-a6ea-208d0e7b995c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:22.762999 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9addd1ff-4e0f-4329-a6ea-208d0e7b995c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:22.763760 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9addd1ff-4e0f-4329-a6ea-208d0e7b995c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:22.901235 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-9addd1ff-4e0f-4329-a6ea-208d0e7b995c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:22.908927 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-9addd1ff-4e0f-4329-a6ea-208d0e7b995c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:22.910415 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-9addd1ff-4e0f-4329-a6ea-208d0e7b995c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:22.912233 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-9addd1ff-4e0f-4329-a6ea-208d0e7b995c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1673 microversion: 2.20 time: 0.171004 May 10 21:26:22.912233 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 386/773] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:26:22 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1673 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:26:23.931330 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-2bf73fa6-68b6-44e2-a692-fe8377359b79 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:23.931938 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-2bf73fa6-68b6-44e2-a692-fe8377359b79 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:23.938354 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2bf73fa6-68b6-44e2-a692-fe8377359b79 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:23.938820 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2bf73fa6-68b6-44e2-a692-fe8377359b79 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:23.939726 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2bf73fa6-68b6-44e2-a692-fe8377359b79 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:23.940158 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2bf73fa6-68b6-44e2-a692-fe8377359b79 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:24.073611 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-2bf73fa6-68b6-44e2-a692-fe8377359b79 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:24.081531 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-2bf73fa6-68b6-44e2-a692-fe8377359b79 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:24.083100 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-2bf73fa6-68b6-44e2-a692-fe8377359b79 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:24.086535 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-2bf73fa6-68b6-44e2-a692-fe8377359b79 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1673 microversion: 2.20 time: 0.157474 May 10 21:26:24.086535 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 388/774] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:26:23 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:26:24.268208 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-ba18a6d9-4297-416d-9e25-e897e75ee8a5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da5ab4e6-d376-40a2-85ec-d421782417e5"}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:26:24.269298 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-ba18a6d9-4297-416d-9e25-e897e75ee8a5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: 5141f323-2d73-494e-a167-49a618d1f67a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:24.275802 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ba18a6d9-4297-416d-9e25-e897e75ee8a5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:24.276293 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ba18a6d9-4297-416d-9e25-e897e75ee8a5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:24.277622 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ba18a6d9-4297-416d-9e25-e897e75ee8a5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:24.278234 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ba18a6d9-4297-416d-9e25-e897e75ee8a5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:25.102251 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-c02a8dde-f74d-46d7-9364-e878e457a946 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:25.102939 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-c02a8dde-f74d-46d7-9364-e878e457a946 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:25.109211 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c02a8dde-f74d-46d7-9364-e878e457a946 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:25.109649 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c02a8dde-f74d-46d7-9364-e878e457a946 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:25.110399 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c02a8dde-f74d-46d7-9364-e878e457a946 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:25.110851 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c02a8dde-f74d-46d7-9364-e878e457a946 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:25.164091 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-ba18a6d9-4297-416d-9e25-e897e75ee8a5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "POST /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.899716 May 10 21:26:25.164837 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 387/775] 10.222.0.25 () {60 vars in 1322 bytes} [Tue May 10 21:26:24 2022] POST /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a/os-volume_attachments => generated 194 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:26:25.240331 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-c02a8dde-f74d-46d7-9364-e878e457a946 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:25.248732 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-c02a8dde-f74d-46d7-9364-e878e457a946 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:25.250269 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-c02a8dde-f74d-46d7-9364-e878e457a946 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:25.251369 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-c02a8dde-f74d-46d7-9364-e878e457a946 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1731 microversion: 2.20 time: 0.152991 May 10 21:26:25.251928 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 389/776] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:26:25 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:26.271049 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-476b745f-2bba-4e0c-bb89-cafbf7d0f936 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:26.271759 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-476b745f-2bba-4e0c-bb89-cafbf7d0f936 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:26.278036 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-476b745f-2bba-4e0c-bb89-cafbf7d0f936 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:26.278550 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-476b745f-2bba-4e0c-bb89-cafbf7d0f936 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:26.279347 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-476b745f-2bba-4e0c-bb89-cafbf7d0f936 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:26.279796 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-476b745f-2bba-4e0c-bb89-cafbf7d0f936 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:26.407126 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-476b745f-2bba-4e0c-bb89-cafbf7d0f936 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:26.415015 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-476b745f-2bba-4e0c-bb89-cafbf7d0f936 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:26.416493 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-476b745f-2bba-4e0c-bb89-cafbf7d0f936 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:26.421157 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-476b745f-2bba-4e0c-bb89-cafbf7d0f936 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1731 microversion: 2.20 time: 0.151273 May 10 21:26:26.421157 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 388/777] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:26:26 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:26:27.437683 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-63b52d42-b90f-4c06-8f51-6cea6c3ce39a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:27.438322 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-63b52d42-b90f-4c06-8f51-6cea6c3ce39a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:27.444250 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-63b52d42-b90f-4c06-8f51-6cea6c3ce39a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:27.444705 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-63b52d42-b90f-4c06-8f51-6cea6c3ce39a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:27.445522 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-63b52d42-b90f-4c06-8f51-6cea6c3ce39a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:27.445955 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-63b52d42-b90f-4c06-8f51-6cea6c3ce39a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:27.587750 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-63b52d42-b90f-4c06-8f51-6cea6c3ce39a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:27.597322 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-63b52d42-b90f-4c06-8f51-6cea6c3ce39a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:27.598881 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-63b52d42-b90f-4c06-8f51-6cea6c3ce39a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:27.600031 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-63b52d42-b90f-4c06-8f51-6cea6c3ce39a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1731 microversion: 2.20 time: 0.167446 May 10 21:26:27.600605 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 390/778] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:26:27 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:26:28.619330 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-5cc6808f-5520-4e95-bf08-d31498194da2 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:28.619935 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-5cc6808f-5520-4e95-bf08-d31498194da2 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:28.626208 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5cc6808f-5520-4e95-bf08-d31498194da2 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:28.626705 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5cc6808f-5520-4e95-bf08-d31498194da2 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:28.627464 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5cc6808f-5520-4e95-bf08-d31498194da2 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:28.627890 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5cc6808f-5520-4e95-bf08-d31498194da2 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:28.806184 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-5cc6808f-5520-4e95-bf08-d31498194da2 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:28.816213 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-5cc6808f-5520-4e95-bf08-d31498194da2 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:28.817877 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-5cc6808f-5520-4e95-bf08-d31498194da2 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:28.819249 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-5cc6808f-5520-4e95-bf08-d31498194da2 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1731 microversion: 2.20 time: 0.203862 May 10 21:26:28.823668 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 389/779] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:26:28 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1731 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:26:29.837365 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-2004c713-a525-4729-8c7b-f5f805a35576 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:29.837878 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-2004c713-a525-4729-8c7b-f5f805a35576 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:29.845889 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2004c713-a525-4729-8c7b-f5f805a35576 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:29.846332 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2004c713-a525-4729-8c7b-f5f805a35576 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:29.847133 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2004c713-a525-4729-8c7b-f5f805a35576 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:29.847595 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2004c713-a525-4729-8c7b-f5f805a35576 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:29.984602 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-2004c713-a525-4729-8c7b-f5f805a35576 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:29.993553 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-2004c713-a525-4729-8c7b-f5f805a35576 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:29.996120 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-2004c713-a525-4729-8c7b-f5f805a35576 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:29.998262 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-2004c713-a525-4729-8c7b-f5f805a35576 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1731 microversion: 2.20 time: 0.164856 May 10 21:26:29.999307 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 391/780] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:26:29 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:26:31.017186 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-18dc1965-bce0-431c-be30-a8d5eba16a03 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:31.018393 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-18dc1965-bce0-431c-be30-a8d5eba16a03 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:31.025388 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-18dc1965-bce0-431c-be30-a8d5eba16a03 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:31.026129 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-18dc1965-bce0-431c-be30-a8d5eba16a03 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:31.027253 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-18dc1965-bce0-431c-be30-a8d5eba16a03 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:31.027851 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-18dc1965-bce0-431c-be30-a8d5eba16a03 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:31.160426 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-18dc1965-bce0-431c-be30-a8d5eba16a03 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:31.168457 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-18dc1965-bce0-431c-be30-a8d5eba16a03 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:31.170116 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-18dc1965-bce0-431c-be30-a8d5eba16a03 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:31.171306 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-18dc1965-bce0-431c-be30-a8d5eba16a03 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1731 microversion: 2.20 time: 0.158147 May 10 21:26:31.171869 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 390/781] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:26:31 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:26:32.189758 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-f6603d30-3487-4b82-9fdb-1b2c9a525f9c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:32.190363 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-f6603d30-3487-4b82-9fdb-1b2c9a525f9c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:32.196915 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f6603d30-3487-4b82-9fdb-1b2c9a525f9c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:32.197359 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f6603d30-3487-4b82-9fdb-1b2c9a525f9c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:32.198127 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f6603d30-3487-4b82-9fdb-1b2c9a525f9c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:32.198593 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f6603d30-3487-4b82-9fdb-1b2c9a525f9c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:32.325949 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-f6603d30-3487-4b82-9fdb-1b2c9a525f9c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:32.334136 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-f6603d30-3487-4b82-9fdb-1b2c9a525f9c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:32.335732 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-f6603d30-3487-4b82-9fdb-1b2c9a525f9c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:32.336876 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-f6603d30-3487-4b82-9fdb-1b2c9a525f9c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1731 microversion: 2.20 time: 0.151087 May 10 21:26:32.337445 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 392/782] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:26:32 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:33.355591 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-2eeebabd-cb96-462b-8957-f62db8fc470e tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:33.356296 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-2eeebabd-cb96-462b-8957-f62db8fc470e tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:33.362591 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2eeebabd-cb96-462b-8957-f62db8fc470e tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:33.363019 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2eeebabd-cb96-462b-8957-f62db8fc470e tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:33.363773 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2eeebabd-cb96-462b-8957-f62db8fc470e tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:33.364203 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2eeebabd-cb96-462b-8957-f62db8fc470e tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:33.504081 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2eeebabd-cb96-462b-8957-f62db8fc470e tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:33.513285 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2eeebabd-cb96-462b-8957-f62db8fc470e tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:33.515158 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2eeebabd-cb96-462b-8957-f62db8fc470e tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:33.516675 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-2eeebabd-cb96-462b-8957-f62db8fc470e tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1731 microversion: 2.20 time: 0.165030 May 10 21:26:33.517413 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 391/783] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:26:33 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:26:34.539881 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-99ec4154-e6c1-4d41-a3b3-de98a7b8b4b7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:34.541111 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-99ec4154-e6c1-4d41-a3b3-de98a7b8b4b7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:34.550635 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-99ec4154-e6c1-4d41-a3b3-de98a7b8b4b7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:34.551322 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-99ec4154-e6c1-4d41-a3b3-de98a7b8b4b7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:34.552265 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-99ec4154-e6c1-4d41-a3b3-de98a7b8b4b7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:34.552887 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-99ec4154-e6c1-4d41-a3b3-de98a7b8b4b7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:34.724933 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-99ec4154-e6c1-4d41-a3b3-de98a7b8b4b7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:34.735241 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-99ec4154-e6c1-4d41-a3b3-de98a7b8b4b7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:34.737072 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-99ec4154-e6c1-4d41-a3b3-de98a7b8b4b7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:34.738411 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-99ec4154-e6c1-4d41-a3b3-de98a7b8b4b7 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1731 microversion: 2.20 time: 0.206990 May 10 21:26:34.739572 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 393/784] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:26:34 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1731 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:26:35.757745 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-cfe1114d-643f-4b78-afce-a56405534f5a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:35.758622 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-cfe1114d-643f-4b78-afce-a56405534f5a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:35.770234 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cfe1114d-643f-4b78-afce-a56405534f5a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:35.772158 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cfe1114d-643f-4b78-afce-a56405534f5a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:35.773859 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cfe1114d-643f-4b78-afce-a56405534f5a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:35.775500 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cfe1114d-643f-4b78-afce-a56405534f5a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:35.959121 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-cfe1114d-643f-4b78-afce-a56405534f5a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:35.968058 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-cfe1114d-643f-4b78-afce-a56405534f5a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:35.982648 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-cfe1114d-643f-4b78-afce-a56405534f5a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:35.982648 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-cfe1114d-643f-4b78-afce-a56405534f5a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1731 microversion: 2.20 time: 0.217978 May 10 21:26:35.982648 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 392/785] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:26:35 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1731 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:26:36.989951 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-054fb2ea-0672-43bd-b7c0-ec7e2149dae9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:36.990614 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-054fb2ea-0672-43bd-b7c0-ec7e2149dae9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:36.997784 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-054fb2ea-0672-43bd-b7c0-ec7e2149dae9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:36.998226 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-054fb2ea-0672-43bd-b7c0-ec7e2149dae9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:36.999001 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-054fb2ea-0672-43bd-b7c0-ec7e2149dae9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:36.999427 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-054fb2ea-0672-43bd-b7c0-ec7e2149dae9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:37.135877 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-054fb2ea-0672-43bd-b7c0-ec7e2149dae9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:37.144253 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-054fb2ea-0672-43bd-b7c0-ec7e2149dae9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:37.145734 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-054fb2ea-0672-43bd-b7c0-ec7e2149dae9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:37.146903 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-054fb2ea-0672-43bd-b7c0-ec7e2149dae9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1731 microversion: 2.20 time: 0.160866 May 10 21:26:37.147473 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 394/786] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:26:36 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:26:38.164923 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-8a0bb868-1cd9-4977-9c2f-6fda61edcc6a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:38.165546 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-8a0bb868-1cd9-4977-9c2f-6fda61edcc6a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:38.172409 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8a0bb868-1cd9-4977-9c2f-6fda61edcc6a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:38.172844 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8a0bb868-1cd9-4977-9c2f-6fda61edcc6a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:38.173629 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8a0bb868-1cd9-4977-9c2f-6fda61edcc6a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:38.174052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8a0bb868-1cd9-4977-9c2f-6fda61edcc6a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:38.304968 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8a0bb868-1cd9-4977-9c2f-6fda61edcc6a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:38.313710 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8a0bb868-1cd9-4977-9c2f-6fda61edcc6a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:38.315327 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8a0bb868-1cd9-4977-9c2f-6fda61edcc6a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:38.316723 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-8a0bb868-1cd9-4977-9c2f-6fda61edcc6a tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1731 microversion: 2.20 time: 0.155600 May 10 21:26:38.317290 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 393/787] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:26:38 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:26:39.335727 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-d160395a-abfe-47f3-b442-51cd89764a08 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:39.336326 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-d160395a-abfe-47f3-b442-51cd89764a08 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:39.343644 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d160395a-abfe-47f3-b442-51cd89764a08 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:39.344091 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d160395a-abfe-47f3-b442-51cd89764a08 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:39.344864 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d160395a-abfe-47f3-b442-51cd89764a08 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:39.345298 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d160395a-abfe-47f3-b442-51cd89764a08 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:39.472689 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-d160395a-abfe-47f3-b442-51cd89764a08 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:39.480412 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-d160395a-abfe-47f3-b442-51cd89764a08 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:39.482182 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-d160395a-abfe-47f3-b442-51cd89764a08 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:39.483351 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-d160395a-abfe-47f3-b442-51cd89764a08 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1731 microversion: 2.20 time: 0.151682 May 10 21:26:39.483910 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 395/788] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:26:39 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:26:40.501808 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-5cad17cf-b2da-4c33-b093-09b206bb62e9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:40.502406 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-5cad17cf-b2da-4c33-b093-09b206bb62e9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:40.509033 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5cad17cf-b2da-4c33-b093-09b206bb62e9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:40.509472 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5cad17cf-b2da-4c33-b093-09b206bb62e9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:40.510552 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5cad17cf-b2da-4c33-b093-09b206bb62e9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:40.510936 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5cad17cf-b2da-4c33-b093-09b206bb62e9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:40.644463 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-5cad17cf-b2da-4c33-b093-09b206bb62e9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:40.652279 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-5cad17cf-b2da-4c33-b093-09b206bb62e9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:40.653913 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-5cad17cf-b2da-4c33-b093-09b206bb62e9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:40.654978 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-5cad17cf-b2da-4c33-b093-09b206bb62e9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1731 microversion: 2.20 time: 0.157824 May 10 21:26:40.655552 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 394/789] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:26:40 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:26:41.173292 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-86e2f88d-f71d-4bd7-a215-ca422e1154b9 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:41.174295 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-86e2f88d-f71d-4bd7-a215-ca422e1154b9 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: 5141f323-2d73-494e-a167-49a618d1f67a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:41.180526 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-86e2f88d-f71d-4bd7-a215-ca422e1154b9 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:41.180961 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-86e2f88d-f71d-4bd7-a215-ca422e1154b9 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:41.181713 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-86e2f88d-f71d-4bd7-a215-ca422e1154b9 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:41.182137 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-86e2f88d-f71d-4bd7-a215-ca422e1154b9 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:41.210601 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-86e2f88d-f71d-4bd7-a215-ca422e1154b9 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041756 May 10 21:26:41.211143 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 396/790] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 10 21:26:41 2022] GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:26:41.348926 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4cfc109d-1449-49b8-9952-e6131225395b tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:41.349410 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-4cfc109d-1449-49b8-9952-e6131225395b tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: 5141f323-2d73-494e-a167-49a618d1f67a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:41.355795 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4cfc109d-1449-49b8-9952-e6131225395b tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:41.356235 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4cfc109d-1449-49b8-9952-e6131225395b tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:41.357144 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4cfc109d-1449-49b8-9952-e6131225395b tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:41.357547 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4cfc109d-1449-49b8-9952-e6131225395b tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:41.385739 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4cfc109d-1449-49b8-9952-e6131225395b tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a/os-volume_attachments/c2c1c215-ee09-44bd-a52d-1bf3c066fa9a" status: 200 len: 194 microversion: 2.1 time: 0.040726 May 10 21:26:41.386309 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 395/791] 10.222.0.25 () {58 vars in 1412 bytes} [Tue May 10 21:26:41 2022] GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a/os-volume_attachments/c2c1c215-ee09-44bd-a52d-1bf3c066fa9a => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:26:41.396596 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-308f539b-34ea-4327-a961-17651f4f90a2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:41.397092 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-308f539b-34ea-4327-a961-17651f4f90a2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: 5141f323-2d73-494e-a167-49a618d1f67a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:41.402932 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-308f539b-34ea-4327-a961-17651f4f90a2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:41.404017 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-308f539b-34ea-4327-a961-17651f4f90a2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:41.404975 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-308f539b-34ea-4327-a961-17651f4f90a2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:41.405410 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-308f539b-34ea-4327-a961-17651f4f90a2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:41.485574 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.objects.instance [None req-308f539b-34ea-4327-a961-17651f4f90a2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lazy-loading 'services' on Instance uuid 5141f323-2d73-494e-a167-49a618d1f67a {{(pid=117678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:26:41.673469 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-df06d5c9-245a-4079-9fbe-f577f99f278c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:41.674079 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-df06d5c9-245a-4079-9fbe-f577f99f278c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:41.680753 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-df06d5c9-245a-4079-9fbe-f577f99f278c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:41.681117 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-df06d5c9-245a-4079-9fbe-f577f99f278c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:41.681889 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-df06d5c9-245a-4079-9fbe-f577f99f278c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:41.682612 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-df06d5c9-245a-4079-9fbe-f577f99f278c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:41.817213 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-df06d5c9-245a-4079-9fbe-f577f99f278c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:41.824977 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-df06d5c9-245a-4079-9fbe-f577f99f278c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:41.826509 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-df06d5c9-245a-4079-9fbe-f577f99f278c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:41.830025 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-df06d5c9-245a-4079-9fbe-f577f99f278c tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1731 microversion: 2.20 time: 0.158703 May 10 21:26:41.830025 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 396/792] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:26:41 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:41.920161 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-308f539b-34ea-4327-a961-17651f4f90a2 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a/os-volume_attachments/c2c1c215-ee09-44bd-a52d-1bf3c066fa9a" status: 202 len: 0 microversion: 2.1 time: 0.527196 May 10 21:26:41.922719 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 397/793] 10.222.0.25 () {58 vars in 1415 bytes} [Tue May 10 21:26:41 2022] DELETE /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a/os-volume_attachments/c2c1c215-ee09-44bd-a52d-1bf3c066fa9a => generated 0 bytes in 529 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 21:26:42.846059 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-47bd9370-8277-418b-ace7-c9bd66b45a89 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:42.851905 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-47bd9370-8277-418b-ace7-c9bd66b45a89 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:42.858919 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-47bd9370-8277-418b-ace7-c9bd66b45a89 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:42.859375 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-47bd9370-8277-418b-ace7-c9bd66b45a89 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:42.860139 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-47bd9370-8277-418b-ace7-c9bd66b45a89 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:42.860566 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-47bd9370-8277-418b-ace7-c9bd66b45a89 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:42.995947 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-47bd9370-8277-418b-ace7-c9bd66b45a89 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:43.004737 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-47bd9370-8277-418b-ace7-c9bd66b45a89 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:43.006353 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-47bd9370-8277-418b-ace7-c9bd66b45a89 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:43.007522 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-47bd9370-8277-418b-ace7-c9bd66b45a89 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1731 microversion: 2.20 time: 0.166332 May 10 21:26:43.008273 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 397/794] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:26:42 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:26:43.655600 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-6deb5b96-4057-42d1-9ea0-5df0b8a03032 req-ce01257b-7f62-4894-84a5-b9a0f5ea9d9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f31bca91-29e8-4a4c-ba97-7e4c993502ef", "name": "network-vif-plugged", "status": "completed", "tag": "53eb87d9-7496-49b6-b83d-932f96780089"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:26:43.663725 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-6deb5b96-4057-42d1-9ea0-5df0b8a03032 req-ce01257b-7f62-4894-84a5-b9a0f5ea9d9d service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:43.664161 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-6deb5b96-4057-42d1-9ea0-5df0b8a03032 req-ce01257b-7f62-4894-84a5-b9a0f5ea9d9d service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:43.675124 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-6deb5b96-4057-42d1-9ea0-5df0b8a03032 req-ce01257b-7f62-4894-84a5-b9a0f5ea9d9d service nova] Creating event network-vif-plugged:53eb87d9-7496-49b6-b83d-932f96780089 for instance f31bca91-29e8-4a4c-ba97-7e4c993502ef on hv-cinder-83608 May 10 21:26:43.680034 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-6deb5b96-4057-42d1-9ea0-5df0b8a03032 req-ce01257b-7f62-4894-84a5-b9a0f5ea9d9d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030233 May 10 21:26:43.680718 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 398/795] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:26:44.027008 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-165fb57c-10a8-4943-bd31-ded3bc199f18 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:44.027615 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-165fb57c-10a8-4943-bd31-ded3bc199f18 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:44.034890 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-165fb57c-10a8-4943-bd31-ded3bc199f18 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:44.035339 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-165fb57c-10a8-4943-bd31-ded3bc199f18 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:44.036114 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-165fb57c-10a8-4943-bd31-ded3bc199f18 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:44.036631 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-165fb57c-10a8-4943-bd31-ded3bc199f18 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:44.084434 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-6bc32288-fec7-4f39-801e-a82d6444b9cc tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:44.085011 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-6bc32288-fec7-4f39-801e-a82d6444b9cc tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: 5141f323-2d73-494e-a167-49a618d1f67a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:44.091007 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6bc32288-fec7-4f39-801e-a82d6444b9cc tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:44.091541 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6bc32288-fec7-4f39-801e-a82d6444b9cc tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:44.092306 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6bc32288-fec7-4f39-801e-a82d6444b9cc tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:44.092738 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6bc32288-fec7-4f39-801e-a82d6444b9cc tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:44.121044 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-6bc32288-fec7-4f39-801e-a82d6444b9cc tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a/os-volume_attachments/da5ab4e6-d376-40a2-85ec-d421782417e5" status: 200 len: 194 microversion: 2.1 time: 0.040845 May 10 21:26:44.121629 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 399/796] 10.222.0.25 () {58 vars in 1412 bytes} [Tue May 10 21:26:44 2022] GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a/os-volume_attachments/da5ab4e6-d376-40a2-85ec-d421782417e5 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:26:44.131648 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-61311a70-a2b4-4122-a464-f3b8e5dfbf6a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:44.132064 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-61311a70-a2b4-4122-a464-f3b8e5dfbf6a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: 5141f323-2d73-494e-a167-49a618d1f67a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:44.138177 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-61311a70-a2b4-4122-a464-f3b8e5dfbf6a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:44.138790 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-61311a70-a2b4-4122-a464-f3b8e5dfbf6a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:44.139560 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-61311a70-a2b4-4122-a464-f3b8e5dfbf6a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:44.139990 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-61311a70-a2b4-4122-a464-f3b8e5dfbf6a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:44.170468 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-165fb57c-10a8-4943-bd31-ded3bc199f18 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:44.178366 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-165fb57c-10a8-4943-bd31-ded3bc199f18 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:44.179877 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-165fb57c-10a8-4943-bd31-ded3bc199f18 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:44.181020 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-165fb57c-10a8-4943-bd31-ded3bc199f18 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1731 microversion: 2.20 time: 0.157993 May 10 21:26:44.181574 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 398/797] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:26:44 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:26:44.218588 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.objects.instance [None req-61311a70-a2b4-4122-a464-f3b8e5dfbf6a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lazy-loading 'services' on Instance uuid 5141f323-2d73-494e-a167-49a618d1f67a {{(pid=117678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:26:44.422724 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-61311a70-a2b4-4122-a464-f3b8e5dfbf6a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a/os-volume_attachments/da5ab4e6-d376-40a2-85ec-d421782417e5" status: 202 len: 0 microversion: 2.1 time: 0.294660 May 10 21:26:44.423438 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 400/798] 10.222.0.25 () {58 vars in 1415 bytes} [Tue May 10 21:26:44 2022] DELETE /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a/os-volume_attachments/da5ab4e6-d376-40a2-85ec-d421782417e5 => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 21:26:45.200216 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-142643b9-f1a8-4de2-a293-506838cdddbb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:45.200837 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-142643b9-f1a8-4de2-a293-506838cdddbb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:45.207873 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-142643b9-f1a8-4de2-a293-506838cdddbb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:45.208348 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-142643b9-f1a8-4de2-a293-506838cdddbb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:45.209131 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-142643b9-f1a8-4de2-a293-506838cdddbb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:45.209567 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-142643b9-f1a8-4de2-a293-506838cdddbb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:45.356332 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-142643b9-f1a8-4de2-a293-506838cdddbb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:45.371304 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-142643b9-f1a8-4de2-a293-506838cdddbb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:45.372920 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-142643b9-f1a8-4de2-a293-506838cdddbb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:45.374217 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-142643b9-f1a8-4de2-a293-506838cdddbb tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1731 microversion: 2.20 time: 0.177955 May 10 21:26:45.379034 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 399/799] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:26:45 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:26:46.394042 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-2ddfbf80-4405-47f4-82fa-af7a365dd68b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:46.394767 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-2ddfbf80-4405-47f4-82fa-af7a365dd68b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:46.400955 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2ddfbf80-4405-47f4-82fa-af7a365dd68b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:46.401389 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2ddfbf80-4405-47f4-82fa-af7a365dd68b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:46.402145 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2ddfbf80-4405-47f4-82fa-af7a365dd68b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:46.402610 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2ddfbf80-4405-47f4-82fa-af7a365dd68b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:46.545390 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-2ddfbf80-4405-47f4-82fa-af7a365dd68b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:46.554347 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-2ddfbf80-4405-47f4-82fa-af7a365dd68b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:46.555864 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-2ddfbf80-4405-47f4-82fa-af7a365dd68b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:46.557087 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-2ddfbf80-4405-47f4-82fa-af7a365dd68b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1731 microversion: 2.20 time: 0.167754 May 10 21:26:46.558328 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 401/800] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:26:46 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:26:46.663294 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-f444a880-3807-4e1e-a459-20389566c371 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:46.664263 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-f444a880-3807-4e1e-a459-20389566c371 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: 5141f323-2d73-494e-a167-49a618d1f67a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:46.670661 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f444a880-3807-4e1e-a459-20389566c371 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:46.671270 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f444a880-3807-4e1e-a459-20389566c371 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:46.672040 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f444a880-3807-4e1e-a459-20389566c371 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:46.672477 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f444a880-3807-4e1e-a459-20389566c371 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:46.702307 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-f444a880-3807-4e1e-a459-20389566c371 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043481 May 10 21:26:46.702910 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 400/801] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 10 21:26:46 2022] GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 21:26:46.813305 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-929cfdde-1a24-4d29-b560-46e8b1bb8589 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:46.813305 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-929cfdde-1a24-4d29-b560-46e8b1bb8589 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: 5141f323-2d73-494e-a167-49a618d1f67a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:46.814214 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-929cfdde-1a24-4d29-b560-46e8b1bb8589 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:46.814698 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-929cfdde-1a24-4d29-b560-46e8b1bb8589 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:46.815468 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-929cfdde-1a24-4d29-b560-46e8b1bb8589 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:46.815900 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-929cfdde-1a24-4d29-b560-46e8b1bb8589 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:46.844164 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-929cfdde-1a24-4d29-b560-46e8b1bb8589 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041450 May 10 21:26:46.844731 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 402/802] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 10 21:26:46 2022] GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 21:26:46.902754 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-fcd217af-efe1-4fb5-8c31-3d82deeca99a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:46.905174 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-fcd217af-efe1-4fb5-8c31-3d82deeca99a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: 5141f323-2d73-494e-a167-49a618d1f67a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:46.909810 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fcd217af-efe1-4fb5-8c31-3d82deeca99a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:46.910249 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fcd217af-efe1-4fb5-8c31-3d82deeca99a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:46.911041 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fcd217af-efe1-4fb5-8c31-3d82deeca99a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:46.911467 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fcd217af-efe1-4fb5-8c31-3d82deeca99a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:46.937886 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-fcd217af-efe1-4fb5-8c31-3d82deeca99a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: 5141f323-2d73-494e-a167-49a618d1f67a] Going to try to terminate instance {{(pid=117679) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 21:26:47.228775 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-fcd217af-efe1-4fb5-8c31-3d82deeca99a tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a" status: 204 len: 0 microversion: 2.1 time: 0.329732 May 10 21:26:47.229390 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 401/803] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 10 21:26:46 2022] DELETE /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 21:26:47.237782 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-620fa988-b00b-44d9-bf5b-2256bc7e8d29 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:47.238391 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-620fa988-b00b-44d9-bf5b-2256bc7e8d29 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: 5141f323-2d73-494e-a167-49a618d1f67a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:47.244253 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-620fa988-b00b-44d9-bf5b-2256bc7e8d29 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:47.244696 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-620fa988-b00b-44d9-bf5b-2256bc7e8d29 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:47.245446 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-620fa988-b00b-44d9-bf5b-2256bc7e8d29 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:47.245876 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-620fa988-b00b-44d9-bf5b-2256bc7e8d29 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:47.376117 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-620fa988-b00b-44d9-bf5b-2256bc7e8d29 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:47.383621 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-620fa988-b00b-44d9-bf5b-2256bc7e8d29 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a" status: 200 len: 1671 microversion: 2.1 time: 0.149861 May 10 21:26:47.384190 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 403/804] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:26:47 2022] GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a => generated 1671 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:47.513440 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-ced65658-ec31-403f-9528-9b0f084d1006 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:47.513902 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-ced65658-ec31-403f-9528-9b0f084d1006 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 77e29a35-349a-4aca-a98e-fccec1f7723a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:47.519885 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ced65658-ec31-403f-9528-9b0f084d1006 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:47.520346 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ced65658-ec31-403f-9528-9b0f084d1006 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:47.521103 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ced65658-ec31-403f-9528-9b0f084d1006 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:47.521531 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ced65658-ec31-403f-9528-9b0f084d1006 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:47.545913 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-ced65658-ec31-403f-9528-9b0f084d1006 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a/ips" status: 200 len: 150 microversion: 2.1 time: 0.037164 May 10 21:26:47.546569 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 402/805] 10.222.0.25 () {58 vars in 1247 bytes} [Tue May 10 21:26:47 2022] GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:26:47.576478 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-f67bb305-b4a1-4d34-b925-2987322fd97d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:47.577084 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-f67bb305-b4a1-4d34-b925-2987322fd97d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:47.583749 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f67bb305-b4a1-4d34-b925-2987322fd97d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:47.584199 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f67bb305-b4a1-4d34-b925-2987322fd97d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:47.584955 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f67bb305-b4a1-4d34-b925-2987322fd97d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:47.585377 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f67bb305-b4a1-4d34-b925-2987322fd97d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:47.719799 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-f67bb305-b4a1-4d34-b925-2987322fd97d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:47.727703 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-f67bb305-b4a1-4d34-b925-2987322fd97d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:47.729208 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-f67bb305-b4a1-4d34-b925-2987322fd97d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:47.730570 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-f67bb305-b4a1-4d34-b925-2987322fd97d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1718 microversion: 2.20 time: 0.157943 May 10 21:26:47.730979 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 404/806] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:26:47 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:26:48.401128 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-1a7d32b0-4627-4c8d-b39b-bea43fe2f8a4 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:48.401674 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-1a7d32b0-4627-4c8d-b39b-bea43fe2f8a4 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: 5141f323-2d73-494e-a167-49a618d1f67a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:48.408908 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1a7d32b0-4627-4c8d-b39b-bea43fe2f8a4 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:48.409356 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1a7d32b0-4627-4c8d-b39b-bea43fe2f8a4 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:48.410118 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1a7d32b0-4627-4c8d-b39b-bea43fe2f8a4 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:48.410581 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1a7d32b0-4627-4c8d-b39b-bea43fe2f8a4 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:48.539866 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1a7d32b0-4627-4c8d-b39b-bea43fe2f8a4 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:48.547598 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-1a7d32b0-4627-4c8d-b39b-bea43fe2f8a4 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a" status: 200 len: 1671 microversion: 2.1 time: 0.150441 May 10 21:26:48.548176 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 403/807] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:26:48 2022] GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a => generated 1671 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:26:49.129577 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-67488a0c-b32a-4e6e-bd53-bc006b896e60 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69208501-7283-4015-af3d-d33c922f6085"}} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:26:49.130971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-67488a0c-b32a-4e6e-bd53-bc006b896e60 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 77e29a35-349a-4aca-a98e-fccec1f7723a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:49.137344 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-67488a0c-b32a-4e6e-bd53-bc006b896e60 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:49.137784 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-67488a0c-b32a-4e6e-bd53-bc006b896e60 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:49.138566 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-67488a0c-b32a-4e6e-bd53-bc006b896e60 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:49.138993 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-67488a0c-b32a-4e6e-bd53-bc006b896e60 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:49.564903 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4e1882ce-3ef8-450f-93a9-8544b59cb8c8 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:49.565552 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-4e1882ce-3ef8-450f-93a9-8544b59cb8c8 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: 5141f323-2d73-494e-a167-49a618d1f67a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:49.572036 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4e1882ce-3ef8-450f-93a9-8544b59cb8c8 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:49.572472 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4e1882ce-3ef8-450f-93a9-8544b59cb8c8 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:49.573253 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4e1882ce-3ef8-450f-93a9-8544b59cb8c8 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:49.573678 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4e1882ce-3ef8-450f-93a9-8544b59cb8c8 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:49.643371 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-4e1882ce-3ef8-450f-93a9-8544b59cb8c8 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:49.651089 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4e1882ce-3ef8-450f-93a9-8544b59cb8c8 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a" status: 200 len: 1604 microversion: 2.1 time: 0.090219 May 10 21:26:49.654779 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 404/808] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:26:49 2022] GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a => generated 1604 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:26:49.885325 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-67488a0c-b32a-4e6e-bd53-bc006b896e60 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "POST /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.759286 May 10 21:26:49.886488 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 405/809] 10.222.0.25 () {60 vars in 1322 bytes} [Tue May 10 21:26:49 2022] POST /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a/os-volume_attachments => generated 194 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:26:49.970293 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-7c117591-a075-4d8c-adba-96d86123ddbd req-705bdca7-5f21-4ad5-98a5-68da10cc0d87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5141f323-2d73-494e-a167-49a618d1f67a", "name": "network-vif-deleted", "tag": "04a8540b-67b6-4a39-b9c9-65408369b364"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:26:49.978606 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-7c117591-a075-4d8c-adba-96d86123ddbd req-705bdca7-5f21-4ad5-98a5-68da10cc0d87 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:49.979203 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-7c117591-a075-4d8c-adba-96d86123ddbd req-705bdca7-5f21-4ad5-98a5-68da10cc0d87 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:49.996391 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-7c117591-a075-4d8c-adba-96d86123ddbd req-705bdca7-5f21-4ad5-98a5-68da10cc0d87 service nova] Creating event network-vif-deleted:04a8540b-67b6-4a39-b9c9-65408369b364 for instance 5141f323-2d73-494e-a167-49a618d1f67a on hv-cinder-83608 May 10 21:26:50.002561 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-7c117591-a075-4d8c-adba-96d86123ddbd req-705bdca7-5f21-4ad5-98a5-68da10cc0d87 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036040 May 10 21:26:50.003575 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 405/810] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:26:50.678075 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-45a4cdfb-bd55-46aa-8468-d5511c405e85 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:50.679034 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-45a4cdfb-bd55-46aa-8468-d5511c405e85 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: 5141f323-2d73-494e-a167-49a618d1f67a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:50.685986 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-45a4cdfb-bd55-46aa-8468-d5511c405e85 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:50.687120 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-45a4cdfb-bd55-46aa-8468-d5511c405e85 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:50.688645 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-45a4cdfb-bd55-46aa-8468-d5511c405e85 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:50.689083 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-45a4cdfb-bd55-46aa-8468-d5511c405e85 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:50.721854 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-45a4cdfb-bd55-46aa-8468-d5511c405e85 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:50.722389 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-45a4cdfb-bd55-46aa-8468-d5511c405e85 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:50.722874 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.objects.instance [None req-45a4cdfb-bd55-46aa-8468-d5511c405e85 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lazy-loading 'fault' on Instance uuid 5141f323-2d73-494e-a167-49a618d1f67a {{(pid=117678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:26:50.767276 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-45a4cdfb-bd55-46aa-8468-d5511c405e85 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eb9dfc751a4b44a8d4d7a03138f0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604bb43d90e344d3a89838c6575d12c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:50.775618 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-45a4cdfb-bd55-46aa-8468-d5511c405e85 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a" status: 200 len: 1326 microversion: 2.1 time: 0.109880 May 10 21:26:50.778207 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 406/811] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:26:50 2022] GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a => generated 1326 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:26:51.794127 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-f7978e2d-d7aa-463d-b2fa-8d7b65044366 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:51.794926 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-f7978e2d-d7aa-463d-b2fa-8d7b65044366 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: 5141f323-2d73-494e-a167-49a618d1f67a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:51.802260 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f7978e2d-d7aa-463d-b2fa-8d7b65044366 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:51.802738 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f7978e2d-d7aa-463d-b2fa-8d7b65044366 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:51.803505 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f7978e2d-d7aa-463d-b2fa-8d7b65044366 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:51.803939 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f7978e2d-d7aa-463d-b2fa-8d7b65044366 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:51.817737 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-f7978e2d-d7aa-463d-b2fa-8d7b65044366 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] HTTP exception thrown: Instance 5141f323-2d73-494e-a167-49a618d1f67a could not be found. May 10 21:26:51.819382 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-f7978e2d-d7aa-463d-b2fa-8d7b65044366 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Request method failure captured: May 10 21:26:51.819382 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: request: GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a HTTP/1.1 May 10 21:26:51.819382 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept: application/json May 10 21:26:51.819382 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity May 10 21:26:51.819382 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Connection: close May 10 21:26:51.819382 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Length: 0 May 10 21:26:51.819382 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Type: application/json May 10 21:26:51.819382 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Host: 10.222.0.25 May 10 21:26:51.819382 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None May 10 21:26:51.819382 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 May 10 21:26:51.819382 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABietcY-t0vlEI6Xr4dyPWLr9tioOexYfyEUPbYCXYJ4ksyZvxUZVrhXrQRmekb5g_uKcvciv7CkAlQJJ5acYI4TzbPJP7yhM5erNpPxfCWlCHTcn33NeNbOAXEUtggv1a5ReAeyw11PlAI5P5LC6NHPghk894HwWU9mIncs8G43mu8VaA May 10 21:26:51.819382 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Id: None May 10 21:26:51.819382 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Name: None May 10 21:26:51.819382 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed May 10 21:26:51.819382 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True May 10 21:26:51.819382 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default May 10 21:26:51.819382 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default May 10 21:26:51.819382 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Id: 604bb43d90e344d3a89838c6575d12c2 May 10 21:26:51.819382 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-AttachVolumeTestJSON-801563513 May 10 21:26:51.819382 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Role: member,reader May 10 21:26:51.819382 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Roles: member,reader May 10 21:26:51.821191 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/604bb43d90e344d3a89838c6575d12c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_604bb43d90e344d3a89838c6575d12c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/604bb43d90e344d3a89838c6575d12c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/604bb43d90e344d3a89838c6575d12c2"}]}] May 10 21:26:51.821191 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-AttachVolumeTestJSON-801563513 May 10 21:26:51.821191 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Id: 604bb43d90e344d3a89838c6575d12c2 May 10 21:26:51.821191 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-AttachVolumeTestJSON-801563513 May 10 21:26:51.821191 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User: tempest-AttachVolumeTestJSON-801563513-project May 10 21:26:51.821191 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default May 10 21:26:51.821191 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default May 10 21:26:51.821191 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Id: 05eb9dfc751a4b44a8d4d7a03138f0d4 May 10 21:26:51.821191 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-AttachVolumeTestJSON-801563513-project May 10 21:26:51.821191 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: method: > May 10 21:26:51.821191 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: exception: Instance 5141f323-2d73-494e-a167-49a618d1f67a could not be found. May 10 21:26:51.821191 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: action_args: {'id': '5141f323-2d73-494e-a167-49a618d1f67a'} May 10 21:26:51.822177 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:26:51.822177 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:26:51.822177 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:26:51.822177 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:26:51.822177 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:26:51.822177 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:26:51.822177 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:26:51.822177 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:26:51.822177 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:26:51.822177 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:26:51.822177 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5141f323-2d73-494e-a167-49a618d1f67a could not be found. May 10 21:26:51.822177 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:26:51.822177 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:26:51.822177 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:26:51.822177 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:26:51.822177 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:26:51.822177 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:26:51.822177 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:26:51.822177 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:26:51.822177 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:26:51.823736 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:26:51.823736 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:26:51.823736 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:26:51.823736 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:26:51.823736 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:26:51.823736 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:26:51.823736 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:26:51.823736 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5141f323-2d73-494e-a167-49a618d1f67a could not be found. May 10 21:26:51.823736 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:26:51.823736 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:26:51.823736 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:26:51.823736 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:26:51.823736 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:26:51.823736 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:26:51.823736 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:26:51.823736 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:26:51.823736 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5141f323-2d73-494e-a167-49a618d1f67a could not be found. May 10 21:26:51.823736 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:26:51.825374 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-f7978e2d-d7aa-463d-b2fa-8d7b65044366 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Returning 404 to user: Instance 5141f323-2d73-494e-a167-49a618d1f67a could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:26:51.825374 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-f7978e2d-d7aa-463d-b2fa-8d7b65044366 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a" status: 404 len: 111 microversion: 2.1 time: 0.031489 May 10 21:26:51.825374 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 406/812] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:26:51 2022] GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:26:51.831680 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-ed627b02-ac35-4bbb-8e4c-434c044d4aa9 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '.version_select at 0x7f7aef673c10>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:51.950382 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-ed627b02-ac35-4bbb-8e4c-434c044d4aa9 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-875324762" status: 202 len: 0 microversion: 2.1 time: 0.123921 May 10 21:26:51.950998 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 407/813] 10.222.0.25 () {58 vars in 1217 bytes} [Tue May 10 21:26:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-875324762 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 21:26:55.195202 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-76149ed7-715f-4099-bdb5-fd992755684d tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:55.195757 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-76149ed7-715f-4099-bdb5-fd992755684d tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: 5141f323-2d73-494e-a167-49a618d1f67a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:55.202058 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-76149ed7-715f-4099-bdb5-fd992755684d tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:55.202543 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-76149ed7-715f-4099-bdb5-fd992755684d tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:55.203350 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-76149ed7-715f-4099-bdb5-fd992755684d tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:55.203779 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-76149ed7-715f-4099-bdb5-fd992755684d tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:55.219744 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-76149ed7-715f-4099-bdb5-fd992755684d tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] HTTP exception thrown: Instance 5141f323-2d73-494e-a167-49a618d1f67a could not be found. May 10 21:26:55.221443 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-76149ed7-715f-4099-bdb5-fd992755684d tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Request method failure captured: May 10 21:26:55.221443 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: request: DELETE /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a HTTP/1.1 May 10 21:26:55.221443 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept: application/json May 10 21:26:55.221443 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity May 10 21:26:55.221443 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Connection: close May 10 21:26:55.221443 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Length: 0 May 10 21:26:55.221443 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Type: application/json May 10 21:26:55.221443 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Host: 10.222.0.25 May 10 21:26:55.221443 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None May 10 21:26:55.221443 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 May 10 21:26:55.221443 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABietcY-t0vlEI6Xr4dyPWLr9tioOexYfyEUPbYCXYJ4ksyZvxUZVrhXrQRmekb5g_uKcvciv7CkAlQJJ5acYI4TzbPJP7yhM5erNpPxfCWlCHTcn33NeNbOAXEUtggv1a5ReAeyw11PlAI5P5LC6NHPghk894HwWU9mIncs8G43mu8VaA May 10 21:26:55.221443 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Id: None May 10 21:26:55.221443 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Name: None May 10 21:26:55.221443 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed May 10 21:26:55.221443 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True May 10 21:26:55.221443 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default May 10 21:26:55.221443 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default May 10 21:26:55.221443 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Id: 604bb43d90e344d3a89838c6575d12c2 May 10 21:26:55.221443 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-AttachVolumeTestJSON-801563513 May 10 21:26:55.221443 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Role: member,reader May 10 21:26:55.221443 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Roles: member,reader May 10 21:26:55.222977 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/604bb43d90e344d3a89838c6575d12c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_604bb43d90e344d3a89838c6575d12c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/604bb43d90e344d3a89838c6575d12c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/604bb43d90e344d3a89838c6575d12c2"}]}] May 10 21:26:55.222977 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-AttachVolumeTestJSON-801563513 May 10 21:26:55.222977 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Id: 604bb43d90e344d3a89838c6575d12c2 May 10 21:26:55.222977 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-AttachVolumeTestJSON-801563513 May 10 21:26:55.222977 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User: tempest-AttachVolumeTestJSON-801563513-project May 10 21:26:55.222977 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default May 10 21:26:55.222977 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default May 10 21:26:55.222977 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Id: 05eb9dfc751a4b44a8d4d7a03138f0d4 May 10 21:26:55.222977 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-AttachVolumeTestJSON-801563513-project May 10 21:26:55.222977 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: method: > May 10 21:26:55.222977 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: exception: Instance 5141f323-2d73-494e-a167-49a618d1f67a could not be found. May 10 21:26:55.222977 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: action_args: {'id': '5141f323-2d73-494e-a167-49a618d1f67a'} May 10 21:26:55.223694 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:26:55.223694 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:26:55.223694 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:26:55.223694 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:26:55.223694 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:26:55.223694 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:26:55.223694 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:26:55.223694 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:26:55.223694 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:26:55.223694 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:26:55.223694 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5141f323-2d73-494e-a167-49a618d1f67a could not be found. May 10 21:26:55.223694 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:26:55.223694 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:26:55.223694 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:26:55.223694 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:26:55.223694 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:26:55.223694 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:26:55.223694 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:26:55.223694 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:26:55.223694 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:26:55.224865 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:26:55.224865 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 21:26:55.224865 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 21:26:55.224865 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 21:26:55.224865 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 21:26:55.224865 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:26:55.224865 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:26:55.224865 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:26:55.224865 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:26:55.224865 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5141f323-2d73-494e-a167-49a618d1f67a could not be found. May 10 21:26:55.224865 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:26:55.224865 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:26:55.224865 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:26:55.224865 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:26:55.224865 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:26:55.224865 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:26:55.224865 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:26:55.224865 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:26:55.224865 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5141f323-2d73-494e-a167-49a618d1f67a could not be found. May 10 21:26:55.224865 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:26:55.226105 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-76149ed7-715f-4099-bdb5-fd992755684d tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Returning 404 to user: Instance 5141f323-2d73-494e-a167-49a618d1f67a could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:26:55.226105 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-76149ed7-715f-4099-bdb5-fd992755684d tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a" status: 404 len: 111 microversion: 2.1 time: 0.031516 May 10 21:26:55.226105 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 407/814] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 10 21:26:55 2022] DELETE /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:26:55.231641 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-b0ffb81f-51f0-4773-af60-f9d88198b743 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:55.232247 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-b0ffb81f-51f0-4773-af60-f9d88198b743 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: 5141f323-2d73-494e-a167-49a618d1f67a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:55.239761 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b0ffb81f-51f0-4773-af60-f9d88198b743 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:55.240202 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b0ffb81f-51f0-4773-af60-f9d88198b743 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:55.240967 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b0ffb81f-51f0-4773-af60-f9d88198b743 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:55.241421 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b0ffb81f-51f0-4773-af60-f9d88198b743 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:55.254831 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.wsgi [None req-b0ffb81f-51f0-4773-af60-f9d88198b743 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] HTTP exception thrown: Instance 5141f323-2d73-494e-a167-49a618d1f67a could not be found. May 10 21:26:55.256444 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-b0ffb81f-51f0-4773-af60-f9d88198b743 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Request method failure captured: May 10 21:26:55.256444 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: request: GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a HTTP/1.1 May 10 21:26:55.256444 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept: application/json May 10 21:26:55.256444 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept-Encoding: identity May 10 21:26:55.256444 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Connection: close May 10 21:26:55.256444 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Length: 0 May 10 21:26:55.256444 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Type: application/json May 10 21:26:55.256444 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Host: 10.222.0.25 May 10 21:26:55.256444 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Openstack-System-Scope: None May 10 21:26:55.256444 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: User-Agent: python-urllib3/1.26.9 May 10 21:26:55.256444 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Auth-Token: gAAAAABietcY-t0vlEI6Xr4dyPWLr9tioOexYfyEUPbYCXYJ4ksyZvxUZVrhXrQRmekb5g_uKcvciv7CkAlQJJ5acYI4TzbPJP7yhM5erNpPxfCWlCHTcn33NeNbOAXEUtggv1a5ReAeyw11PlAI5P5LC6NHPghk894HwWU9mIncs8G43mu8VaA May 10 21:26:55.256444 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Id: None May 10 21:26:55.256444 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Name: None May 10 21:26:55.256444 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Identity-Status: Confirmed May 10 21:26:55.256444 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Is-Admin-Project: True May 10 21:26:55.256444 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Id: default May 10 21:26:55.256444 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Name: Default May 10 21:26:55.256444 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Id: 604bb43d90e344d3a89838c6575d12c2 May 10 21:26:55.256444 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Name: tempest-AttachVolumeTestJSON-801563513 May 10 21:26:55.256444 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Role: member,reader May 10 21:26:55.256444 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Roles: member,reader May 10 21:26:55.257955 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/604bb43d90e344d3a89838c6575d12c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_604bb43d90e344d3a89838c6575d12c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/604bb43d90e344d3a89838c6575d12c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/604bb43d90e344d3a89838c6575d12c2"}]}] May 10 21:26:55.257955 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant: tempest-AttachVolumeTestJSON-801563513 May 10 21:26:55.257955 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Id: 604bb43d90e344d3a89838c6575d12c2 May 10 21:26:55.257955 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Name: tempest-AttachVolumeTestJSON-801563513 May 10 21:26:55.257955 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User: tempest-AttachVolumeTestJSON-801563513-project May 10 21:26:55.257955 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Id: default May 10 21:26:55.257955 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Name: Default May 10 21:26:55.257955 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Id: 05eb9dfc751a4b44a8d4d7a03138f0d4 May 10 21:26:55.257955 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Name: tempest-AttachVolumeTestJSON-801563513-project May 10 21:26:55.257955 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: method: > May 10 21:26:55.257955 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: exception: Instance 5141f323-2d73-494e-a167-49a618d1f67a could not be found. May 10 21:26:55.257955 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: action_args: {'id': '5141f323-2d73-494e-a167-49a618d1f67a'} May 10 21:26:55.258830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:26:55.258830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:26:55.258830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:26:55.258830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:26:55.258830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:26:55.258830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:26:55.258830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:26:55.258830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:26:55.258830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:26:55.258830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:26:55.258830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5141f323-2d73-494e-a167-49a618d1f67a could not be found. May 10 21:26:55.258830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:26:55.258830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:26:55.258830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:26:55.258830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:26:55.258830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:26:55.258830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:26:55.258830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:26:55.258830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:26:55.258830 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:26:55.260046 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:26:55.260046 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:26:55.260046 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:26:55.260046 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:26:55.260046 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:26:55.260046 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:26:55.260046 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:26:55.260046 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5141f323-2d73-494e-a167-49a618d1f67a could not be found. May 10 21:26:55.260046 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:26:55.260046 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:26:55.260046 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:26:55.260046 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:26:55.260046 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:26:55.260046 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:26:55.260046 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:26:55.260046 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:26:55.260046 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5141f323-2d73-494e-a167-49a618d1f67a could not be found. May 10 21:26:55.260046 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:26:55.261660 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-b0ffb81f-51f0-4773-af60-f9d88198b743 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Returning 404 to user: Instance 5141f323-2d73-494e-a167-49a618d1f67a could not be found. {{(pid=117678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:26:55.261660 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-b0ffb81f-51f0-4773-af60-f9d88198b743 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a" status: 404 len: 111 microversion: 2.1 time: 0.030431 May 10 21:26:55.261660 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 408/815] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:26:55 2022] GET /compute/v2.1/servers/5141f323-2d73-494e-a167-49a618d1f67a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:26:58.584843 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-280f2b19-745c-4ca6-ba4b-b79f4865f91f tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:58.585355 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-280f2b19-745c-4ca6-ba4b-b79f4865f91f tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:58.591693 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-280f2b19-745c-4ca6-ba4b-b79f4865f91f tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:58.592130 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-280f2b19-745c-4ca6-ba4b-b79f4865f91f tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:58.592886 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-280f2b19-745c-4ca6-ba4b-b79f4865f91f tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:58.593306 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-280f2b19-745c-4ca6-ba4b-b79f4865f91f tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:58.606903 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-280f2b19-745c-4ca6-ba4b-b79f4865f91f tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] HTTP exception thrown: Instance ef13be90-688a-4ebe-8b3c-c8187cf9cd70 could not be found. May 10 21:26:58.608437 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-280f2b19-745c-4ca6-ba4b-b79f4865f91f tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Request method failure captured: May 10 21:26:58.608437 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: request: DELETE /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 HTTP/1.1 May 10 21:26:58.608437 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept: application/json May 10 21:26:58.608437 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity May 10 21:26:58.608437 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Connection: close May 10 21:26:58.608437 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Length: 0 May 10 21:26:58.608437 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Type: application/json May 10 21:26:58.608437 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Host: 10.222.0.25 May 10 21:26:58.608437 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None May 10 21:26:58.608437 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 May 10 21:26:58.608437 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABietcY-t0vlEI6Xr4dyPWLr9tioOexYfyEUPbYCXYJ4ksyZvxUZVrhXrQRmekb5g_uKcvciv7CkAlQJJ5acYI4TzbPJP7yhM5erNpPxfCWlCHTcn33NeNbOAXEUtggv1a5ReAeyw11PlAI5P5LC6NHPghk894HwWU9mIncs8G43mu8VaA May 10 21:26:58.608437 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Id: None May 10 21:26:58.608437 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Name: None May 10 21:26:58.608437 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed May 10 21:26:58.608437 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True May 10 21:26:58.608437 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default May 10 21:26:58.608437 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default May 10 21:26:58.608437 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Id: 604bb43d90e344d3a89838c6575d12c2 May 10 21:26:58.608437 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-AttachVolumeTestJSON-801563513 May 10 21:26:58.608437 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Role: member,reader May 10 21:26:58.608437 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Roles: member,reader May 10 21:26:58.610194 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/604bb43d90e344d3a89838c6575d12c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_604bb43d90e344d3a89838c6575d12c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/604bb43d90e344d3a89838c6575d12c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/604bb43d90e344d3a89838c6575d12c2"}]}] May 10 21:26:58.610194 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-AttachVolumeTestJSON-801563513 May 10 21:26:58.610194 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Id: 604bb43d90e344d3a89838c6575d12c2 May 10 21:26:58.610194 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-AttachVolumeTestJSON-801563513 May 10 21:26:58.610194 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User: tempest-AttachVolumeTestJSON-801563513-project May 10 21:26:58.610194 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default May 10 21:26:58.610194 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default May 10 21:26:58.610194 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Id: 05eb9dfc751a4b44a8d4d7a03138f0d4 May 10 21:26:58.610194 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-AttachVolumeTestJSON-801563513-project May 10 21:26:58.610194 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: method: > May 10 21:26:58.610194 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: exception: Instance ef13be90-688a-4ebe-8b3c-c8187cf9cd70 could not be found. May 10 21:26:58.610194 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: action_args: {'id': 'ef13be90-688a-4ebe-8b3c-c8187cf9cd70'} May 10 21:26:58.611137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:26:58.611137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:26:58.611137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:26:58.611137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:26:58.611137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:26:58.611137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:26:58.611137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:26:58.611137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:26:58.611137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:26:58.611137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:26:58.611137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef13be90-688a-4ebe-8b3c-c8187cf9cd70 could not be found. May 10 21:26:58.611137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:26:58.611137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:26:58.611137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:26:58.611137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:26:58.611137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:26:58.611137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:26:58.611137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:26:58.611137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:26:58.611137 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:26:58.613376 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:26:58.613376 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 21:26:58.613376 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 21:26:58.613376 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 21:26:58.613376 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 21:26:58.613376 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:26:58.613376 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:26:58.613376 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:26:58.613376 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:26:58.613376 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef13be90-688a-4ebe-8b3c-c8187cf9cd70 could not be found. May 10 21:26:58.613376 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:26:58.613376 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:26:58.613376 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:26:58.613376 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:26:58.613376 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:26:58.613376 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:26:58.613376 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:26:58.613376 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:26:58.613376 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef13be90-688a-4ebe-8b3c-c8187cf9cd70 could not be found. May 10 21:26:58.613376 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:26:58.615130 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-280f2b19-745c-4ca6-ba4b-b79f4865f91f tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Returning 404 to user: Instance ef13be90-688a-4ebe-8b3c-c8187cf9cd70 could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:26:58.615130 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-280f2b19-745c-4ca6-ba4b-b79f4865f91f tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 404 len: 111 microversion: 2.1 time: 0.028991 May 10 21:26:58.615130 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 408/816] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 10 21:26:58 2022] DELETE /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:26:58.619010 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-c361b0de-0c7b-4195-b1b3-8fe82dde93d5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:58.619612 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-c361b0de-0c7b-4195-b1b3-8fe82dde93d5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] [instance: ef13be90-688a-4ebe-8b3c-c8187cf9cd70] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:58.625864 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c361b0de-0c7b-4195-b1b3-8fe82dde93d5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:58.627569 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c361b0de-0c7b-4195-b1b3-8fe82dde93d5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:58.627569 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c361b0de-0c7b-4195-b1b3-8fe82dde93d5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:58.627569 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c361b0de-0c7b-4195-b1b3-8fe82dde93d5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:58.641828 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.wsgi [None req-c361b0de-0c7b-4195-b1b3-8fe82dde93d5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] HTTP exception thrown: Instance ef13be90-688a-4ebe-8b3c-c8187cf9cd70 could not be found. May 10 21:26:58.643366 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-c361b0de-0c7b-4195-b1b3-8fe82dde93d5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Request method failure captured: May 10 21:26:58.643366 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: request: GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 HTTP/1.1 May 10 21:26:58.643366 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept: application/json May 10 21:26:58.643366 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept-Encoding: identity May 10 21:26:58.643366 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Connection: close May 10 21:26:58.643366 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Length: 0 May 10 21:26:58.643366 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Type: application/json May 10 21:26:58.643366 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Host: 10.222.0.25 May 10 21:26:58.643366 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Openstack-System-Scope: None May 10 21:26:58.643366 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: User-Agent: python-urllib3/1.26.9 May 10 21:26:58.643366 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Auth-Token: gAAAAABietcY-t0vlEI6Xr4dyPWLr9tioOexYfyEUPbYCXYJ4ksyZvxUZVrhXrQRmekb5g_uKcvciv7CkAlQJJ5acYI4TzbPJP7yhM5erNpPxfCWlCHTcn33NeNbOAXEUtggv1a5ReAeyw11PlAI5P5LC6NHPghk894HwWU9mIncs8G43mu8VaA May 10 21:26:58.643366 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Id: None May 10 21:26:58.643366 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Name: None May 10 21:26:58.643366 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Identity-Status: Confirmed May 10 21:26:58.643366 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Is-Admin-Project: True May 10 21:26:58.643366 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Id: default May 10 21:26:58.643366 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Name: Default May 10 21:26:58.643366 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Id: 604bb43d90e344d3a89838c6575d12c2 May 10 21:26:58.643366 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Name: tempest-AttachVolumeTestJSON-801563513 May 10 21:26:58.643366 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Role: member,reader May 10 21:26:58.643366 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Roles: member,reader May 10 21:26:58.646184 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/604bb43d90e344d3a89838c6575d12c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_604bb43d90e344d3a89838c6575d12c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/604bb43d90e344d3a89838c6575d12c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/604bb43d90e344d3a89838c6575d12c2"}]}] May 10 21:26:58.646184 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant: tempest-AttachVolumeTestJSON-801563513 May 10 21:26:58.646184 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Id: 604bb43d90e344d3a89838c6575d12c2 May 10 21:26:58.646184 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Name: tempest-AttachVolumeTestJSON-801563513 May 10 21:26:58.646184 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User: tempest-AttachVolumeTestJSON-801563513-project May 10 21:26:58.646184 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Id: default May 10 21:26:58.646184 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Name: Default May 10 21:26:58.646184 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Id: 05eb9dfc751a4b44a8d4d7a03138f0d4 May 10 21:26:58.646184 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Name: tempest-AttachVolumeTestJSON-801563513-project May 10 21:26:58.646184 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: method: > May 10 21:26:58.646184 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: exception: Instance ef13be90-688a-4ebe-8b3c-c8187cf9cd70 could not be found. May 10 21:26:58.646184 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: action_args: {'id': 'ef13be90-688a-4ebe-8b3c-c8187cf9cd70'} May 10 21:26:58.647261 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:26:58.647261 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:26:58.647261 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:26:58.647261 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:26:58.647261 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:26:58.647261 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:26:58.647261 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:26:58.647261 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:26:58.647261 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:26:58.647261 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:26:58.647261 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef13be90-688a-4ebe-8b3c-c8187cf9cd70 could not be found. May 10 21:26:58.647261 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:26:58.647261 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:26:58.647261 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:26:58.647261 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:26:58.647261 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:26:58.647261 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:26:58.647261 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:26:58.647261 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:26:58.647261 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:26:58.648737 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:26:58.648737 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:26:58.648737 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:26:58.648737 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:26:58.648737 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:26:58.648737 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:26:58.648737 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:26:58.648737 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef13be90-688a-4ebe-8b3c-c8187cf9cd70 could not be found. May 10 21:26:58.648737 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:26:58.648737 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:26:58.648737 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:26:58.648737 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:26:58.648737 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:26:58.648737 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:26:58.648737 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:26:58.648737 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:26:58.648737 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef13be90-688a-4ebe-8b3c-c8187cf9cd70 could not be found. May 10 21:26:58.648737 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:26:58.650214 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-c361b0de-0c7b-4195-b1b3-8fe82dde93d5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] Returning 404 to user: Instance ef13be90-688a-4ebe-8b3c-c8187cf9cd70 could not be found. {{(pid=117678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:26:58.650214 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-c361b0de-0c7b-4195-b1b3-8fe82dde93d5 tempest-AttachVolumeTestJSON-801563513 tempest-AttachVolumeTestJSON-801563513-project] 10.222.0.25 "GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70" status: 404 len: 111 microversion: 2.1 time: 0.030503 May 10 21:26:58.650214 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 409/817] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:26:58 2022] GET /compute/v2.1/servers/ef13be90-688a-4ebe-8b3c-c8187cf9cd70 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 21:26:59.584984 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-1d1f9f7c-9143-4b83-bc23-1086b6a8aa18 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:59.585574 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-1d1f9f7c-9143-4b83-bc23-1086b6a8aa18 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 77e29a35-349a-4aca-a98e-fccec1f7723a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:59.591571 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1d1f9f7c-9143-4b83-bc23-1086b6a8aa18 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:59.592014 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1d1f9f7c-9143-4b83-bc23-1086b6a8aa18 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:59.592782 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1d1f9f7c-9143-4b83-bc23-1086b6a8aa18 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:59.593209 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1d1f9f7c-9143-4b83-bc23-1086b6a8aa18 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:59.674007 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.objects.instance [None req-1d1f9f7c-9143-4b83-bc23-1086b6a8aa18 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lazy-loading 'services' on Instance uuid 77e29a35-349a-4aca-a98e-fccec1f7723a {{(pid=117679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:26:59.902507 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-1d1f9f7c-9143-4b83-bc23-1086b6a8aa18 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "DELETE /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a/os-volume_attachments/69208501-7283-4015-af3d-d33c922f6085" status: 202 len: 0 microversion: 2.1 time: 0.322427 May 10 21:26:59.903111 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 409/818] 10.222.0.25 () {58 vars in 1415 bytes} [Tue May 10 21:26:59 2022] DELETE /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a/os-volume_attachments/69208501-7283-4015-af3d-d33c922f6085 => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 21:26:59.911690 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-da7df668-7ac4-4964-959a-4d5062f7abcd tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:59.912769 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-da7df668-7ac4-4964-959a-4d5062f7abcd tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 77e29a35-349a-4aca-a98e-fccec1f7723a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:59.919418 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-da7df668-7ac4-4964-959a-4d5062f7abcd tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:59.919863 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-da7df668-7ac4-4964-959a-4d5062f7abcd tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:59.920638 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-da7df668-7ac4-4964-959a-4d5062f7abcd tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:59.921085 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-da7df668-7ac4-4964-959a-4d5062f7abcd tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:59.952051 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-da7df668-7ac4-4964-959a-4d5062f7abcd tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044495 May 10 21:26:59.952678 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 410/819] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 10 21:26:59 2022] GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:27:00.964852 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e13b4b81-4c68-406c-a004-9f370757b4d6 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:00.965933 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-e13b4b81-4c68-406c-a004-9f370757b4d6 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 77e29a35-349a-4aca-a98e-fccec1f7723a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:00.972611 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e13b4b81-4c68-406c-a004-9f370757b4d6 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:00.973124 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e13b4b81-4c68-406c-a004-9f370757b4d6 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:00.974031 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e13b4b81-4c68-406c-a004-9f370757b4d6 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:00.974564 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e13b4b81-4c68-406c-a004-9f370757b4d6 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:01.005743 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-e13b4b81-4c68-406c-a004-9f370757b4d6 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045562 May 10 21:27:01.006310 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 410/820] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 10 21:27:00 2022] GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:27:02.017580 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-6a3940df-742a-4ebc-a7f9-e2d80af87172 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:02.018505 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-6a3940df-742a-4ebc-a7f9-e2d80af87172 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 77e29a35-349a-4aca-a98e-fccec1f7723a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:02.026255 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6a3940df-742a-4ebc-a7f9-e2d80af87172 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:02.026738 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6a3940df-742a-4ebc-a7f9-e2d80af87172 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:02.027971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6a3940df-742a-4ebc-a7f9-e2d80af87172 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:02.028436 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6a3940df-742a-4ebc-a7f9-e2d80af87172 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:02.059948 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-6a3940df-742a-4ebc-a7f9-e2d80af87172 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046415 May 10 21:27:02.060974 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 411/821] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 10 21:27:02 2022] GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:27:03.070882 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6726db98-3e85-4f94-a95b-035039afde0e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:03.071802 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-6726db98-3e85-4f94-a95b-035039afde0e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 77e29a35-349a-4aca-a98e-fccec1f7723a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:03.078076 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6726db98-3e85-4f94-a95b-035039afde0e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:03.078570 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6726db98-3e85-4f94-a95b-035039afde0e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:03.079336 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6726db98-3e85-4f94-a95b-035039afde0e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:03.079774 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6726db98-3e85-4f94-a95b-035039afde0e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:03.111492 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-6726db98-3e85-4f94-a95b-035039afde0e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044554 May 10 21:27:03.113609 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 411/822] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 10 21:27:03 2022] GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:27:04.123910 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-42034854-b5b3-45e2-ad50-cd0a9d87a0da tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:04.124827 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-42034854-b5b3-45e2-ad50-cd0a9d87a0da tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 77e29a35-349a-4aca-a98e-fccec1f7723a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:04.131267 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-42034854-b5b3-45e2-ad50-cd0a9d87a0da tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:04.131704 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-42034854-b5b3-45e2-ad50-cd0a9d87a0da tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:04.132461 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-42034854-b5b3-45e2-ad50-cd0a9d87a0da tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:04.132888 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-42034854-b5b3-45e2-ad50-cd0a9d87a0da tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:04.162057 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-42034854-b5b3-45e2-ad50-cd0a9d87a0da tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042121 May 10 21:27:04.162819 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 412/823] 10.222.0.25 () {58 vars in 1301 bytes} [Tue May 10 21:27:04 2022] GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 21:27:04.219997 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-42b9e311-2aae-4937-980f-57b5f991a7de tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:04.220525 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-42b9e311-2aae-4937-980f-57b5f991a7de tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 77e29a35-349a-4aca-a98e-fccec1f7723a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:04.227725 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-42b9e311-2aae-4937-980f-57b5f991a7de tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:04.228174 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-42b9e311-2aae-4937-980f-57b5f991a7de tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:04.228938 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-42b9e311-2aae-4937-980f-57b5f991a7de tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:04.229377 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-42b9e311-2aae-4937-980f-57b5f991a7de tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:04.254110 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-42b9e311-2aae-4937-980f-57b5f991a7de tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 77e29a35-349a-4aca-a98e-fccec1f7723a] Going to try to terminate instance {{(pid=117679) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 21:27:04.566589 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-42b9e311-2aae-4937-980f-57b5f991a7de tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "DELETE /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a" status: 204 len: 0 microversion: 2.1 time: 0.349577 May 10 21:27:04.567317 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 412/824] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 10 21:27:04 2022] DELETE /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 21:27:04.575660 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-305812ef-07fc-4b91-a50c-4c2e1404dd70 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:04.580698 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-305812ef-07fc-4b91-a50c-4c2e1404dd70 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 77e29a35-349a-4aca-a98e-fccec1f7723a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:04.584213 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-305812ef-07fc-4b91-a50c-4c2e1404dd70 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:04.584664 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-305812ef-07fc-4b91-a50c-4c2e1404dd70 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:04.585442 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-305812ef-07fc-4b91-a50c-4c2e1404dd70 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:04.585879 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-305812ef-07fc-4b91-a50c-4c2e1404dd70 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:04.716137 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-305812ef-07fc-4b91-a50c-4c2e1404dd70 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:04.723975 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-305812ef-07fc-4b91-a50c-4c2e1404dd70 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a" status: 200 len: 1681 microversion: 2.1 time: 0.152347 May 10 21:27:04.724544 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 413/825] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:27:04 2022] GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:05.743582 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-ea0dfe96-8c89-4a72-975b-330a46bcfe40 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:05.744277 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-ea0dfe96-8c89-4a72-975b-330a46bcfe40 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 77e29a35-349a-4aca-a98e-fccec1f7723a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:05.750068 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ea0dfe96-8c89-4a72-975b-330a46bcfe40 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:05.750545 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ea0dfe96-8c89-4a72-975b-330a46bcfe40 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:05.751308 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ea0dfe96-8c89-4a72-975b-330a46bcfe40 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:05.751743 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ea0dfe96-8c89-4a72-975b-330a46bcfe40 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:05.885508 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-ea0dfe96-8c89-4a72-975b-330a46bcfe40 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:05.893142 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-ea0dfe96-8c89-4a72-975b-330a46bcfe40 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a" status: 200 len: 1681 microversion: 2.1 time: 0.155112 May 10 21:27:05.910093 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 413/826] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:27:05 2022] GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:06.917059 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-9f49347a-f445-4444-8ceb-c9d1c0109e0c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:06.917686 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-9f49347a-f445-4444-8ceb-c9d1c0109e0c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 77e29a35-349a-4aca-a98e-fccec1f7723a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:06.924051 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9f49347a-f445-4444-8ceb-c9d1c0109e0c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:06.924495 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9f49347a-f445-4444-8ceb-c9d1c0109e0c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:06.925261 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9f49347a-f445-4444-8ceb-c9d1c0109e0c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:06.926367 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9f49347a-f445-4444-8ceb-c9d1c0109e0c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:07.057844 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-9f49347a-f445-4444-8ceb-c9d1c0109e0c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:07.065375 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-9f49347a-f445-4444-8ceb-c9d1c0109e0c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a" status: 200 len: 1681 microversion: 2.1 time: 0.152169 May 10 21:27:07.065930 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 414/827] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:27:06 2022] GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:08.086843 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a376a8eb-deff-4036-a955-056caf8c2b0e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:08.087558 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-a376a8eb-deff-4036-a955-056caf8c2b0e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 77e29a35-349a-4aca-a98e-fccec1f7723a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:08.096255 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a376a8eb-deff-4036-a955-056caf8c2b0e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:08.096877 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a376a8eb-deff-4036-a955-056caf8c2b0e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:08.098606 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a376a8eb-deff-4036-a955-056caf8c2b0e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:08.099023 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a376a8eb-deff-4036-a955-056caf8c2b0e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:08.372067 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-a376a8eb-deff-4036-a955-056caf8c2b0e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:08.383237 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-a376a8eb-deff-4036-a955-056caf8c2b0e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a" status: 200 len: 1681 microversion: 2.1 time: 0.304219 May 10 21:27:08.383871 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 414/828] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:27:08 2022] GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a => generated 1681 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:09.235955 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-2cd0fc48-491c-4764-9941-e387d3e20f00 req-73d4f62d-d20b-47cc-8118-1cfa73592fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77e29a35-349a-4aca-a98e-fccec1f7723a", "name": "network-vif-deleted", "tag": "ed83693c-e120-41e7-b5f7-1f27045a59aa"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:27:09.245349 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-2cd0fc48-491c-4764-9941-e387d3e20f00 req-73d4f62d-d20b-47cc-8118-1cfa73592fb4 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:09.245803 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-2cd0fc48-491c-4764-9941-e387d3e20f00 req-73d4f62d-d20b-47cc-8118-1cfa73592fb4 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:09.258155 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-2cd0fc48-491c-4764-9941-e387d3e20f00 req-73d4f62d-d20b-47cc-8118-1cfa73592fb4 service nova] Creating event network-vif-deleted:ed83693c-e120-41e7-b5f7-1f27045a59aa for instance 77e29a35-349a-4aca-a98e-fccec1f7723a on hv-cinder-83608 May 10 21:27:09.263679 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-2cd0fc48-491c-4764-9941-e387d3e20f00 req-73d4f62d-d20b-47cc-8118-1cfa73592fb4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031358 May 10 21:27:09.264546 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 415/829] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:27:09.401821 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-be2d8dcf-8d3d-478f-9177-2dffbfc1ca07 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:09.403198 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-be2d8dcf-8d3d-478f-9177-2dffbfc1ca07 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 77e29a35-349a-4aca-a98e-fccec1f7723a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:09.412905 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-be2d8dcf-8d3d-478f-9177-2dffbfc1ca07 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:09.413377 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-be2d8dcf-8d3d-478f-9177-2dffbfc1ca07 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:09.416910 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-be2d8dcf-8d3d-478f-9177-2dffbfc1ca07 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:09.416910 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-be2d8dcf-8d3d-478f-9177-2dffbfc1ca07 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:09.480319 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-be2d8dcf-8d3d-478f-9177-2dffbfc1ca07 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39678abe6e476283f94c675d4ea369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8286226c580f4896aec72c65642fce30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:09.487753 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-be2d8dcf-8d3d-478f-9177-2dffbfc1ca07 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a" status: 200 len: 1326 microversion: 2.1 time: 0.090111 May 10 21:27:09.488461 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 415/830] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:27:09 2022] GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a => generated 1326 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:10.506073 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-c4b7d221-671b-46b7-85a9-bf04e22d0d5d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:10.506806 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-c4b7d221-671b-46b7-85a9-bf04e22d0d5d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 77e29a35-349a-4aca-a98e-fccec1f7723a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:10.513685 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c4b7d221-671b-46b7-85a9-bf04e22d0d5d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:10.514134 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c4b7d221-671b-46b7-85a9-bf04e22d0d5d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:10.514921 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c4b7d221-671b-46b7-85a9-bf04e22d0d5d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:10.515358 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c4b7d221-671b-46b7-85a9-bf04e22d0d5d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:10.528598 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.wsgi [None req-c4b7d221-671b-46b7-85a9-bf04e22d0d5d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] HTTP exception thrown: Instance 77e29a35-349a-4aca-a98e-fccec1f7723a could not be found. May 10 21:27:10.530201 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-c4b7d221-671b-46b7-85a9-bf04e22d0d5d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Request method failure captured: May 10 21:27:10.530201 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: request: GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a HTTP/1.1 May 10 21:27:10.530201 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept: application/json May 10 21:27:10.530201 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept-Encoding: identity May 10 21:27:10.530201 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Connection: close May 10 21:27:10.530201 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Length: 0 May 10 21:27:10.530201 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Type: application/json May 10 21:27:10.530201 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Host: 10.222.0.25 May 10 21:27:10.530201 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Openstack-System-Scope: None May 10 21:27:10.530201 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: User-Agent: python-urllib3/1.26.9 May 10 21:27:10.530201 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Auth-Token: gAAAAABietccfViYRiOQpEa4ldvOHZyUgOQ2ZBBatS9SA20GCDt_AgmFvo4vE33WkYc6oqnMaRFSIYJbwKR_AxZ5OfoHdxsDJwPaySjCJQ5rrDhZmJbbtmsjCkN_RYEyYX6qvdoHvFk_bXj7SkSAx705IP0l1sxFz6bBTFTgIB8EAyrOf7pHKV8 May 10 21:27:10.530201 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Id: None May 10 21:27:10.530201 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Name: None May 10 21:27:10.530201 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Identity-Status: Confirmed May 10 21:27:10.530201 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Is-Admin-Project: True May 10 21:27:10.530201 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Id: default May 10 21:27:10.530201 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Name: Default May 10 21:27:10.530201 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Id: 8286226c580f4896aec72c65642fce30 May 10 21:27:10.530201 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Name: tempest-AttachVolumeNegativeTest-1863330069 May 10 21:27:10.530201 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Role: member,reader May 10 21:27:10.530201 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Roles: member,reader May 10 21:27:10.531850 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8286226c580f4896aec72c65642fce30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8286226c580f4896aec72c65642fce30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8286226c580f4896aec72c65642fce30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8286226c580f4896aec72c65642fce30"}]}] May 10 21:27:10.531850 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant: tempest-AttachVolumeNegativeTest-1863330069 May 10 21:27:10.531850 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Id: 8286226c580f4896aec72c65642fce30 May 10 21:27:10.531850 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1863330069 May 10 21:27:10.531850 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User: tempest-AttachVolumeNegativeTest-1863330069-project May 10 21:27:10.531850 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Id: default May 10 21:27:10.531850 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Name: Default May 10 21:27:10.531850 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Id: ca39678abe6e476283f94c675d4ea369 May 10 21:27:10.531850 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Name: tempest-AttachVolumeNegativeTest-1863330069-project May 10 21:27:10.531850 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: method: > May 10 21:27:10.531850 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: exception: Instance 77e29a35-349a-4aca-a98e-fccec1f7723a could not be found. May 10 21:27:10.531850 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: action_args: {'id': '77e29a35-349a-4aca-a98e-fccec1f7723a'} May 10 21:27:10.532785 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:27:10.532785 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:27:10.532785 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:27:10.532785 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:27:10.532785 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:27:10.532785 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:27:10.532785 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:27:10.532785 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:27:10.532785 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:27:10.532785 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:27:10.532785 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77e29a35-349a-4aca-a98e-fccec1f7723a could not be found. May 10 21:27:10.532785 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:27:10.532785 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:27:10.532785 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:27:10.532785 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:27:10.532785 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:27:10.532785 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:27:10.532785 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:27:10.532785 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:27:10.532785 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:27:10.534372 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:27:10.534372 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:27:10.534372 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:27:10.534372 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:27:10.534372 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:27:10.534372 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:27:10.534372 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:27:10.534372 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77e29a35-349a-4aca-a98e-fccec1f7723a could not be found. May 10 21:27:10.534372 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:27:10.534372 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:27:10.534372 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:27:10.534372 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:27:10.534372 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:27:10.534372 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:27:10.534372 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:27:10.534372 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:27:10.534372 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77e29a35-349a-4aca-a98e-fccec1f7723a could not be found. May 10 21:27:10.534372 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:27:10.536552 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-c4b7d221-671b-46b7-85a9-bf04e22d0d5d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Returning 404 to user: Instance 77e29a35-349a-4aca-a98e-fccec1f7723a could not be found. {{(pid=117678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:27:10.536552 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-c4b7d221-671b-46b7-85a9-bf04e22d0d5d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a" status: 404 len: 111 microversion: 2.1 time: 0.030513 May 10 21:27:10.536552 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 416/831] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:27:10 2022] GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:27:10.540969 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-586daa88-6aff-41e0-9066-ea95136173ed tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '.version_select at 0x7f7aef6a4c10>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:10.612391 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-586daa88-6aff-41e0-9066-ea95136173ed tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-266562216" status: 202 len: 0 microversion: 2.1 time: 0.075168 May 10 21:27:10.613558 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 416/832] 10.222.0.25 () {58 vars in 1217 bytes} [Tue May 10 21:27:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-266562216 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 21:27:12.635827 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-b6d0be8a-ea62-4f0e-ba0a-b5c9550a9106 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:12.636426 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-b6d0be8a-ea62-4f0e-ba0a-b5c9550a9106 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 77e29a35-349a-4aca-a98e-fccec1f7723a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:12.642905 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b6d0be8a-ea62-4f0e-ba0a-b5c9550a9106 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:12.643444 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b6d0be8a-ea62-4f0e-ba0a-b5c9550a9106 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:12.644219 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b6d0be8a-ea62-4f0e-ba0a-b5c9550a9106 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:12.644648 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b6d0be8a-ea62-4f0e-ba0a-b5c9550a9106 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:12.658575 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.wsgi [None req-b6d0be8a-ea62-4f0e-ba0a-b5c9550a9106 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] HTTP exception thrown: Instance 77e29a35-349a-4aca-a98e-fccec1f7723a could not be found. May 10 21:27:12.666529 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-b6d0be8a-ea62-4f0e-ba0a-b5c9550a9106 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Request method failure captured: May 10 21:27:12.666529 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: request: DELETE /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a HTTP/1.1 May 10 21:27:12.666529 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept: application/json May 10 21:27:12.666529 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept-Encoding: identity May 10 21:27:12.666529 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Connection: close May 10 21:27:12.666529 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Length: 0 May 10 21:27:12.666529 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Type: application/json May 10 21:27:12.666529 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Host: 10.222.0.25 May 10 21:27:12.666529 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Openstack-System-Scope: None May 10 21:27:12.666529 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: User-Agent: python-urllib3/1.26.9 May 10 21:27:12.666529 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Auth-Token: gAAAAABietccfViYRiOQpEa4ldvOHZyUgOQ2ZBBatS9SA20GCDt_AgmFvo4vE33WkYc6oqnMaRFSIYJbwKR_AxZ5OfoHdxsDJwPaySjCJQ5rrDhZmJbbtmsjCkN_RYEyYX6qvdoHvFk_bXj7SkSAx705IP0l1sxFz6bBTFTgIB8EAyrOf7pHKV8 May 10 21:27:12.666529 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Id: None May 10 21:27:12.666529 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Name: None May 10 21:27:12.666529 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Identity-Status: Confirmed May 10 21:27:12.666529 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Is-Admin-Project: True May 10 21:27:12.666529 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Id: default May 10 21:27:12.666529 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Name: Default May 10 21:27:12.666529 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Id: 8286226c580f4896aec72c65642fce30 May 10 21:27:12.666529 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Name: tempest-AttachVolumeNegativeTest-1863330069 May 10 21:27:12.666529 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Role: member,reader May 10 21:27:12.666529 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Roles: member,reader May 10 21:27:12.668130 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8286226c580f4896aec72c65642fce30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8286226c580f4896aec72c65642fce30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8286226c580f4896aec72c65642fce30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8286226c580f4896aec72c65642fce30"}]}] May 10 21:27:12.668130 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant: tempest-AttachVolumeNegativeTest-1863330069 May 10 21:27:12.668130 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Id: 8286226c580f4896aec72c65642fce30 May 10 21:27:12.668130 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1863330069 May 10 21:27:12.668130 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User: tempest-AttachVolumeNegativeTest-1863330069-project May 10 21:27:12.668130 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Id: default May 10 21:27:12.668130 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Name: Default May 10 21:27:12.668130 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Id: ca39678abe6e476283f94c675d4ea369 May 10 21:27:12.668130 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Name: tempest-AttachVolumeNegativeTest-1863330069-project May 10 21:27:12.668130 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: method: > May 10 21:27:12.668130 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: exception: Instance 77e29a35-349a-4aca-a98e-fccec1f7723a could not be found. May 10 21:27:12.668130 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: action_args: {'id': '77e29a35-349a-4aca-a98e-fccec1f7723a'} May 10 21:27:12.668968 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:27:12.668968 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:27:12.668968 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:27:12.668968 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:27:12.668968 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:27:12.668968 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:27:12.668968 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:27:12.668968 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:27:12.668968 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:27:12.668968 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:27:12.668968 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77e29a35-349a-4aca-a98e-fccec1f7723a could not be found. May 10 21:27:12.668968 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:27:12.668968 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:27:12.668968 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:27:12.668968 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:27:12.668968 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:27:12.668968 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:27:12.668968 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:27:12.668968 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:27:12.668968 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:27:12.670393 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:27:12.670393 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 21:27:12.670393 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 21:27:12.670393 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 21:27:12.670393 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 21:27:12.670393 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:27:12.670393 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:27:12.670393 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:27:12.670393 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:27:12.670393 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77e29a35-349a-4aca-a98e-fccec1f7723a could not be found. May 10 21:27:12.670393 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:27:12.670393 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:27:12.670393 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:27:12.670393 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:27:12.670393 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:27:12.670393 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:27:12.670393 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:27:12.670393 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:27:12.670393 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77e29a35-349a-4aca-a98e-fccec1f7723a could not be found. May 10 21:27:12.670393 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:27:12.671914 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-b6d0be8a-ea62-4f0e-ba0a-b5c9550a9106 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Returning 404 to user: Instance 77e29a35-349a-4aca-a98e-fccec1f7723a could not be found. {{(pid=117678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:27:12.671914 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-b6d0be8a-ea62-4f0e-ba0a-b5c9550a9106 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "DELETE /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a" status: 404 len: 111 microversion: 2.1 time: 0.030054 May 10 21:27:12.671914 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 417/833] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 10 21:27:12 2022] DELETE /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:27:12.672161 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6ec46a00-959a-4840-9ed8-893d8b7d30bd tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:12.672161 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-6ec46a00-959a-4840-9ed8-893d8b7d30bd tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 77e29a35-349a-4aca-a98e-fccec1f7723a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:12.679308 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6ec46a00-959a-4840-9ed8-893d8b7d30bd tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:12.679754 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6ec46a00-959a-4840-9ed8-893d8b7d30bd tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:12.680526 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6ec46a00-959a-4840-9ed8-893d8b7d30bd tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:12.680973 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6ec46a00-959a-4840-9ed8-893d8b7d30bd tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:12.695269 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-6ec46a00-959a-4840-9ed8-893d8b7d30bd tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] HTTP exception thrown: Instance 77e29a35-349a-4aca-a98e-fccec1f7723a could not be found. May 10 21:27:12.696901 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6ec46a00-959a-4840-9ed8-893d8b7d30bd tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Request method failure captured: May 10 21:27:12.696901 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: request: GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a HTTP/1.1 May 10 21:27:12.696901 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept: application/json May 10 21:27:12.696901 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity May 10 21:27:12.696901 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Connection: close May 10 21:27:12.696901 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Length: 0 May 10 21:27:12.696901 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Type: application/json May 10 21:27:12.696901 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Host: 10.222.0.25 May 10 21:27:12.696901 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None May 10 21:27:12.696901 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 May 10 21:27:12.696901 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABietccfViYRiOQpEa4ldvOHZyUgOQ2ZBBatS9SA20GCDt_AgmFvo4vE33WkYc6oqnMaRFSIYJbwKR_AxZ5OfoHdxsDJwPaySjCJQ5rrDhZmJbbtmsjCkN_RYEyYX6qvdoHvFk_bXj7SkSAx705IP0l1sxFz6bBTFTgIB8EAyrOf7pHKV8 May 10 21:27:12.696901 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Id: None May 10 21:27:12.696901 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Name: None May 10 21:27:12.696901 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed May 10 21:27:12.696901 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True May 10 21:27:12.696901 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default May 10 21:27:12.696901 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default May 10 21:27:12.696901 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Id: 8286226c580f4896aec72c65642fce30 May 10 21:27:12.696901 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-AttachVolumeNegativeTest-1863330069 May 10 21:27:12.696901 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Role: member,reader May 10 21:27:12.696901 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Roles: member,reader May 10 21:27:12.698526 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8286226c580f4896aec72c65642fce30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8286226c580f4896aec72c65642fce30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8286226c580f4896aec72c65642fce30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8286226c580f4896aec72c65642fce30"}]}] May 10 21:27:12.698526 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-AttachVolumeNegativeTest-1863330069 May 10 21:27:12.698526 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Id: 8286226c580f4896aec72c65642fce30 May 10 21:27:12.698526 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1863330069 May 10 21:27:12.698526 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User: tempest-AttachVolumeNegativeTest-1863330069-project May 10 21:27:12.698526 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default May 10 21:27:12.698526 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default May 10 21:27:12.698526 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Id: ca39678abe6e476283f94c675d4ea369 May 10 21:27:12.698526 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-AttachVolumeNegativeTest-1863330069-project May 10 21:27:12.698526 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: method: > May 10 21:27:12.698526 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: exception: Instance 77e29a35-349a-4aca-a98e-fccec1f7723a could not be found. May 10 21:27:12.698526 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: action_args: {'id': '77e29a35-349a-4aca-a98e-fccec1f7723a'} May 10 21:27:12.699462 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:27:12.699462 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:27:12.699462 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:27:12.699462 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:27:12.699462 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:27:12.699462 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:27:12.699462 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:27:12.699462 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:27:12.699462 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:27:12.699462 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:27:12.699462 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77e29a35-349a-4aca-a98e-fccec1f7723a could not be found. May 10 21:27:12.699462 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:27:12.699462 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:27:12.699462 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:27:12.699462 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:27:12.699462 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:27:12.699462 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:27:12.699462 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:27:12.699462 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:27:12.699462 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:27:12.700929 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:27:12.700929 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:27:12.700929 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:27:12.700929 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:27:12.700929 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:27:12.700929 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:27:12.700929 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:27:12.700929 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77e29a35-349a-4aca-a98e-fccec1f7723a could not be found. May 10 21:27:12.700929 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:27:12.700929 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:27:12.700929 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:27:12.700929 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:27:12.700929 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:27:12.700929 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:27:12.700929 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:27:12.700929 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:27:12.700929 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77e29a35-349a-4aca-a98e-fccec1f7723a could not be found. May 10 21:27:12.700929 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:27:12.702291 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6ec46a00-959a-4840-9ed8-893d8b7d30bd tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Returning 404 to user: Instance 77e29a35-349a-4aca-a98e-fccec1f7723a could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:27:12.702291 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-6ec46a00-959a-4840-9ed8-893d8b7d30bd tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a" status: 404 len: 111 microversion: 2.1 time: 0.031936 May 10 21:27:12.702291 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 417/834] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:27:12 2022] GET /compute/v2.1/servers/77e29a35-349a-4aca-a98e-fccec1f7723a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:27:13.946581 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-3f881eab-f15f-472d-9e5e-5e4b7027567c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:13.947104 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-3f881eab-f15f-472d-9e5e-5e4b7027567c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 11411cb5-9de1-4ea1-8cdf-e770019076dc] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:13.953384 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3f881eab-f15f-472d-9e5e-5e4b7027567c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:13.953835 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3f881eab-f15f-472d-9e5e-5e4b7027567c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:13.954635 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3f881eab-f15f-472d-9e5e-5e4b7027567c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:13.955071 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3f881eab-f15f-472d-9e5e-5e4b7027567c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:13.968426 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.wsgi [None req-3f881eab-f15f-472d-9e5e-5e4b7027567c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] HTTP exception thrown: Instance 11411cb5-9de1-4ea1-8cdf-e770019076dc could not be found. May 10 21:27:13.969997 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-3f881eab-f15f-472d-9e5e-5e4b7027567c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Request method failure captured: May 10 21:27:13.969997 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: request: DELETE /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc HTTP/1.1 May 10 21:27:13.969997 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept: application/json May 10 21:27:13.969997 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept-Encoding: identity May 10 21:27:13.969997 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Connection: close May 10 21:27:13.969997 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Length: 0 May 10 21:27:13.969997 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Type: application/json May 10 21:27:13.969997 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Host: 10.222.0.25 May 10 21:27:13.969997 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Openstack-System-Scope: None May 10 21:27:13.969997 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: User-Agent: python-urllib3/1.26.9 May 10 21:27:13.969997 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Auth-Token: gAAAAABietccfViYRiOQpEa4ldvOHZyUgOQ2ZBBatS9SA20GCDt_AgmFvo4vE33WkYc6oqnMaRFSIYJbwKR_AxZ5OfoHdxsDJwPaySjCJQ5rrDhZmJbbtmsjCkN_RYEyYX6qvdoHvFk_bXj7SkSAx705IP0l1sxFz6bBTFTgIB8EAyrOf7pHKV8 May 10 21:27:13.969997 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Id: None May 10 21:27:13.969997 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Name: None May 10 21:27:13.969997 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Identity-Status: Confirmed May 10 21:27:13.969997 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Is-Admin-Project: True May 10 21:27:13.969997 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Id: default May 10 21:27:13.969997 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Name: Default May 10 21:27:13.969997 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Id: 8286226c580f4896aec72c65642fce30 May 10 21:27:13.969997 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Name: tempest-AttachVolumeNegativeTest-1863330069 May 10 21:27:13.969997 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Role: member,reader May 10 21:27:13.969997 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Roles: member,reader May 10 21:27:13.971566 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8286226c580f4896aec72c65642fce30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8286226c580f4896aec72c65642fce30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8286226c580f4896aec72c65642fce30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8286226c580f4896aec72c65642fce30"}]}] May 10 21:27:13.971566 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant: tempest-AttachVolumeNegativeTest-1863330069 May 10 21:27:13.971566 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Id: 8286226c580f4896aec72c65642fce30 May 10 21:27:13.971566 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1863330069 May 10 21:27:13.971566 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User: tempest-AttachVolumeNegativeTest-1863330069-project May 10 21:27:13.971566 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Id: default May 10 21:27:13.971566 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Name: Default May 10 21:27:13.971566 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Id: ca39678abe6e476283f94c675d4ea369 May 10 21:27:13.971566 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Name: tempest-AttachVolumeNegativeTest-1863330069-project May 10 21:27:13.971566 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: method: > May 10 21:27:13.971566 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: exception: Instance 11411cb5-9de1-4ea1-8cdf-e770019076dc could not be found. May 10 21:27:13.971566 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: action_args: {'id': '11411cb5-9de1-4ea1-8cdf-e770019076dc'} May 10 21:27:13.972317 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:27:13.972317 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:27:13.972317 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:27:13.972317 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:27:13.972317 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:27:13.972317 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:27:13.972317 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:27:13.972317 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:27:13.972317 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:27:13.972317 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:27:13.972317 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11411cb5-9de1-4ea1-8cdf-e770019076dc could not be found. May 10 21:27:13.972317 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:27:13.972317 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:27:13.972317 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:27:13.972317 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:27:13.972317 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:27:13.972317 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:27:13.972317 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:27:13.972317 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:27:13.972317 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:27:13.973516 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:27:13.973516 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 21:27:13.973516 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 21:27:13.973516 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 21:27:13.973516 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 21:27:13.973516 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:27:13.973516 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:27:13.973516 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:27:13.973516 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:27:13.973516 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11411cb5-9de1-4ea1-8cdf-e770019076dc could not be found. May 10 21:27:13.973516 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:27:13.973516 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:27:13.973516 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:27:13.973516 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:27:13.973516 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:27:13.973516 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:27:13.973516 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:27:13.973516 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:27:13.973516 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11411cb5-9de1-4ea1-8cdf-e770019076dc could not be found. May 10 21:27:13.973516 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:27:13.974950 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-3f881eab-f15f-472d-9e5e-5e4b7027567c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Returning 404 to user: Instance 11411cb5-9de1-4ea1-8cdf-e770019076dc could not be found. {{(pid=117678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:27:13.974950 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-3f881eab-f15f-472d-9e5e-5e4b7027567c tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "DELETE /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc" status: 404 len: 111 microversion: 2.1 time: 0.029634 May 10 21:27:13.974950 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 418/835] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 10 21:27:13 2022] DELETE /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:27:13.980460 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6387ecec-5bae-4d39-8aba-878bc46c904e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:13.981078 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-6387ecec-5bae-4d39-8aba-878bc46c904e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 11411cb5-9de1-4ea1-8cdf-e770019076dc] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:13.987191 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6387ecec-5bae-4d39-8aba-878bc46c904e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:13.987639 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6387ecec-5bae-4d39-8aba-878bc46c904e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:13.988411 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6387ecec-5bae-4d39-8aba-878bc46c904e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:13.988842 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6387ecec-5bae-4d39-8aba-878bc46c904e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:14.002749 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-6387ecec-5bae-4d39-8aba-878bc46c904e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] HTTP exception thrown: Instance 11411cb5-9de1-4ea1-8cdf-e770019076dc could not be found. May 10 21:27:14.004270 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6387ecec-5bae-4d39-8aba-878bc46c904e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Request method failure captured: May 10 21:27:14.004270 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: request: GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc HTTP/1.1 May 10 21:27:14.004270 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept: application/json May 10 21:27:14.004270 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity May 10 21:27:14.004270 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Connection: close May 10 21:27:14.004270 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Length: 0 May 10 21:27:14.004270 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Type: application/json May 10 21:27:14.004270 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Host: 10.222.0.25 May 10 21:27:14.004270 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None May 10 21:27:14.004270 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 May 10 21:27:14.004270 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABietccfViYRiOQpEa4ldvOHZyUgOQ2ZBBatS9SA20GCDt_AgmFvo4vE33WkYc6oqnMaRFSIYJbwKR_AxZ5OfoHdxsDJwPaySjCJQ5rrDhZmJbbtmsjCkN_RYEyYX6qvdoHvFk_bXj7SkSAx705IP0l1sxFz6bBTFTgIB8EAyrOf7pHKV8 May 10 21:27:14.004270 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Id: None May 10 21:27:14.004270 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Name: None May 10 21:27:14.004270 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed May 10 21:27:14.004270 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True May 10 21:27:14.004270 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default May 10 21:27:14.004270 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default May 10 21:27:14.004270 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Id: 8286226c580f4896aec72c65642fce30 May 10 21:27:14.004270 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-AttachVolumeNegativeTest-1863330069 May 10 21:27:14.004270 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Role: member,reader May 10 21:27:14.004270 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Roles: member,reader May 10 21:27:14.006463 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8286226c580f4896aec72c65642fce30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8286226c580f4896aec72c65642fce30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8286226c580f4896aec72c65642fce30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8286226c580f4896aec72c65642fce30"}]}] May 10 21:27:14.006463 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-AttachVolumeNegativeTest-1863330069 May 10 21:27:14.006463 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Id: 8286226c580f4896aec72c65642fce30 May 10 21:27:14.006463 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1863330069 May 10 21:27:14.006463 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User: tempest-AttachVolumeNegativeTest-1863330069-project May 10 21:27:14.006463 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default May 10 21:27:14.006463 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default May 10 21:27:14.006463 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Id: ca39678abe6e476283f94c675d4ea369 May 10 21:27:14.006463 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-AttachVolumeNegativeTest-1863330069-project May 10 21:27:14.006463 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: method: > May 10 21:27:14.006463 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: exception: Instance 11411cb5-9de1-4ea1-8cdf-e770019076dc could not be found. May 10 21:27:14.006463 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: action_args: {'id': '11411cb5-9de1-4ea1-8cdf-e770019076dc'} May 10 21:27:14.007244 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:27:14.007244 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:27:14.007244 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:27:14.007244 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:27:14.007244 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:27:14.007244 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:27:14.007244 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:27:14.007244 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:27:14.007244 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:27:14.007244 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:27:14.007244 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11411cb5-9de1-4ea1-8cdf-e770019076dc could not be found. May 10 21:27:14.007244 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:27:14.007244 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:27:14.007244 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:27:14.007244 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:27:14.007244 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:27:14.007244 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:27:14.007244 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:27:14.007244 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:27:14.007244 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:27:14.008829 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:27:14.008829 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:27:14.008829 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:27:14.008829 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:27:14.008829 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:27:14.008829 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:27:14.008829 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:27:14.008829 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11411cb5-9de1-4ea1-8cdf-e770019076dc could not be found. May 10 21:27:14.008829 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:27:14.008829 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:27:14.008829 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:27:14.008829 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:27:14.008829 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:27:14.008829 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:27:14.008829 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:27:14.008829 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:27:14.008829 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11411cb5-9de1-4ea1-8cdf-e770019076dc could not be found. May 10 21:27:14.008829 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:27:14.010062 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6387ecec-5bae-4d39-8aba-878bc46c904e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Returning 404 to user: Instance 11411cb5-9de1-4ea1-8cdf-e770019076dc could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:27:14.010062 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-6387ecec-5bae-4d39-8aba-878bc46c904e tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc" status: 404 len: 111 microversion: 2.1 time: 0.030190 May 10 21:27:14.010062 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 418/836] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:27:13 2022] GET /compute/v2.1/servers/11411cb5-9de1-4ea1-8cdf-e770019076dc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:27:14.016668 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-742fca81-a155-4c2f-a0de-edbf1b1b1339 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:14.017265 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-742fca81-a155-4c2f-a0de-edbf1b1b1339 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 362a9924-7119-4e2e-bd41-d68a5f545009] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:14.023621 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-742fca81-a155-4c2f-a0de-edbf1b1b1339 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:14.024613 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-742fca81-a155-4c2f-a0de-edbf1b1b1339 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:14.024903 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-742fca81-a155-4c2f-a0de-edbf1b1b1339 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:14.025509 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-742fca81-a155-4c2f-a0de-edbf1b1b1339 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:14.039650 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.wsgi [None req-742fca81-a155-4c2f-a0de-edbf1b1b1339 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] HTTP exception thrown: Instance 362a9924-7119-4e2e-bd41-d68a5f545009 could not be found. May 10 21:27:14.041240 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-742fca81-a155-4c2f-a0de-edbf1b1b1339 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Request method failure captured: May 10 21:27:14.041240 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: request: DELETE /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009 HTTP/1.1 May 10 21:27:14.041240 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept: application/json May 10 21:27:14.041240 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept-Encoding: identity May 10 21:27:14.041240 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Connection: close May 10 21:27:14.041240 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Length: 0 May 10 21:27:14.041240 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Type: application/json May 10 21:27:14.041240 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Host: 10.222.0.25 May 10 21:27:14.041240 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Openstack-System-Scope: None May 10 21:27:14.041240 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: User-Agent: python-urllib3/1.26.9 May 10 21:27:14.041240 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Auth-Token: gAAAAABietccfViYRiOQpEa4ldvOHZyUgOQ2ZBBatS9SA20GCDt_AgmFvo4vE33WkYc6oqnMaRFSIYJbwKR_AxZ5OfoHdxsDJwPaySjCJQ5rrDhZmJbbtmsjCkN_RYEyYX6qvdoHvFk_bXj7SkSAx705IP0l1sxFz6bBTFTgIB8EAyrOf7pHKV8 May 10 21:27:14.041240 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Id: None May 10 21:27:14.041240 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Name: None May 10 21:27:14.041240 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Identity-Status: Confirmed May 10 21:27:14.041240 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Is-Admin-Project: True May 10 21:27:14.041240 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Id: default May 10 21:27:14.041240 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Name: Default May 10 21:27:14.041240 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Id: 8286226c580f4896aec72c65642fce30 May 10 21:27:14.041240 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Name: tempest-AttachVolumeNegativeTest-1863330069 May 10 21:27:14.041240 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Role: member,reader May 10 21:27:14.041240 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Roles: member,reader May 10 21:27:14.042850 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8286226c580f4896aec72c65642fce30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8286226c580f4896aec72c65642fce30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8286226c580f4896aec72c65642fce30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8286226c580f4896aec72c65642fce30"}]}] May 10 21:27:14.042850 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant: tempest-AttachVolumeNegativeTest-1863330069 May 10 21:27:14.042850 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Id: 8286226c580f4896aec72c65642fce30 May 10 21:27:14.042850 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1863330069 May 10 21:27:14.042850 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User: tempest-AttachVolumeNegativeTest-1863330069-project May 10 21:27:14.042850 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Id: default May 10 21:27:14.042850 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Name: Default May 10 21:27:14.042850 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Id: ca39678abe6e476283f94c675d4ea369 May 10 21:27:14.042850 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Name: tempest-AttachVolumeNegativeTest-1863330069-project May 10 21:27:14.042850 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: method: > May 10 21:27:14.042850 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: exception: Instance 362a9924-7119-4e2e-bd41-d68a5f545009 could not be found. May 10 21:27:14.042850 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: action_args: {'id': '362a9924-7119-4e2e-bd41-d68a5f545009'} May 10 21:27:14.043689 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:27:14.043689 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:27:14.043689 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:27:14.043689 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:27:14.043689 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:27:14.043689 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:27:14.043689 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:27:14.043689 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:27:14.043689 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:27:14.043689 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:27:14.043689 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 362a9924-7119-4e2e-bd41-d68a5f545009 could not be found. May 10 21:27:14.043689 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:27:14.043689 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:27:14.043689 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:27:14.043689 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:27:14.043689 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:27:14.043689 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:27:14.043689 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:27:14.043689 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:27:14.043689 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:27:14.044940 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:27:14.044940 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 21:27:14.044940 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 21:27:14.044940 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 21:27:14.044940 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 21:27:14.044940 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:27:14.044940 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:27:14.044940 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:27:14.044940 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:27:14.044940 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 362a9924-7119-4e2e-bd41-d68a5f545009 could not be found. May 10 21:27:14.044940 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:27:14.044940 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:27:14.044940 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:27:14.044940 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:27:14.044940 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:27:14.044940 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:27:14.044940 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:27:14.044940 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:27:14.044940 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 362a9924-7119-4e2e-bd41-d68a5f545009 could not be found. May 10 21:27:14.044940 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:27:14.046141 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-742fca81-a155-4c2f-a0de-edbf1b1b1339 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Returning 404 to user: Instance 362a9924-7119-4e2e-bd41-d68a5f545009 could not be found. {{(pid=117678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:27:14.046141 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-742fca81-a155-4c2f-a0de-edbf1b1b1339 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "DELETE /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009" status: 404 len: 111 microversion: 2.1 time: 0.030079 May 10 21:27:14.046141 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 419/837] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 10 21:27:14 2022] DELETE /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:27:14.051774 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-793bef82-bb1b-4747-aabe-840df918e933 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:14.053066 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-793bef82-bb1b-4747-aabe-840df918e933 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 362a9924-7119-4e2e-bd41-d68a5f545009] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:14.059090 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-793bef82-bb1b-4747-aabe-840df918e933 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:14.059616 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-793bef82-bb1b-4747-aabe-840df918e933 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:14.060392 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-793bef82-bb1b-4747-aabe-840df918e933 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:14.060828 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-793bef82-bb1b-4747-aabe-840df918e933 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:14.075132 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-793bef82-bb1b-4747-aabe-840df918e933 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] HTTP exception thrown: Instance 362a9924-7119-4e2e-bd41-d68a5f545009 could not be found. May 10 21:27:14.076656 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-793bef82-bb1b-4747-aabe-840df918e933 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Request method failure captured: May 10 21:27:14.076656 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: request: GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009 HTTP/1.1 May 10 21:27:14.076656 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept: application/json May 10 21:27:14.076656 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity May 10 21:27:14.076656 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Connection: close May 10 21:27:14.076656 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Length: 0 May 10 21:27:14.076656 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Type: application/json May 10 21:27:14.076656 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Host: 10.222.0.25 May 10 21:27:14.076656 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None May 10 21:27:14.076656 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 May 10 21:27:14.076656 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABietccfViYRiOQpEa4ldvOHZyUgOQ2ZBBatS9SA20GCDt_AgmFvo4vE33WkYc6oqnMaRFSIYJbwKR_AxZ5OfoHdxsDJwPaySjCJQ5rrDhZmJbbtmsjCkN_RYEyYX6qvdoHvFk_bXj7SkSAx705IP0l1sxFz6bBTFTgIB8EAyrOf7pHKV8 May 10 21:27:14.076656 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Id: None May 10 21:27:14.076656 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Name: None May 10 21:27:14.076656 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed May 10 21:27:14.076656 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True May 10 21:27:14.076656 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default May 10 21:27:14.076656 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default May 10 21:27:14.076656 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Id: 8286226c580f4896aec72c65642fce30 May 10 21:27:14.076656 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-AttachVolumeNegativeTest-1863330069 May 10 21:27:14.076656 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Role: member,reader May 10 21:27:14.076656 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Roles: member,reader May 10 21:27:14.078266 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8286226c580f4896aec72c65642fce30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8286226c580f4896aec72c65642fce30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8286226c580f4896aec72c65642fce30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8286226c580f4896aec72c65642fce30"}]}] May 10 21:27:14.078266 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-AttachVolumeNegativeTest-1863330069 May 10 21:27:14.078266 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Id: 8286226c580f4896aec72c65642fce30 May 10 21:27:14.078266 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1863330069 May 10 21:27:14.078266 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User: tempest-AttachVolumeNegativeTest-1863330069-project May 10 21:27:14.078266 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default May 10 21:27:14.078266 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default May 10 21:27:14.078266 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Id: ca39678abe6e476283f94c675d4ea369 May 10 21:27:14.078266 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-AttachVolumeNegativeTest-1863330069-project May 10 21:27:14.078266 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: method: > May 10 21:27:14.078266 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: exception: Instance 362a9924-7119-4e2e-bd41-d68a5f545009 could not be found. May 10 21:27:14.078266 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: action_args: {'id': '362a9924-7119-4e2e-bd41-d68a5f545009'} May 10 21:27:14.079156 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:27:14.079156 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:27:14.079156 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:27:14.079156 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:27:14.079156 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:27:14.079156 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:27:14.079156 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:27:14.079156 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:27:14.079156 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:27:14.079156 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:27:14.079156 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 362a9924-7119-4e2e-bd41-d68a5f545009 could not be found. May 10 21:27:14.079156 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:27:14.079156 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:27:14.079156 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:27:14.079156 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:27:14.079156 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:27:14.079156 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:27:14.079156 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:27:14.079156 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:27:14.079156 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:27:14.080348 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:27:14.080348 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:27:14.080348 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:27:14.080348 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:27:14.080348 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:27:14.080348 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:27:14.080348 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:27:14.080348 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 362a9924-7119-4e2e-bd41-d68a5f545009 could not be found. May 10 21:27:14.080348 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:27:14.080348 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:27:14.080348 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:27:14.080348 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:27:14.080348 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:27:14.080348 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:27:14.080348 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:27:14.080348 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:27:14.080348 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 362a9924-7119-4e2e-bd41-d68a5f545009 could not be found. May 10 21:27:14.080348 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:27:14.081432 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-793bef82-bb1b-4747-aabe-840df918e933 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Returning 404 to user: Instance 362a9924-7119-4e2e-bd41-d68a5f545009 could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:27:14.081432 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-793bef82-bb1b-4747-aabe-840df918e933 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009" status: 404 len: 111 microversion: 2.1 time: 0.032063 May 10 21:27:14.081432 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 419/838] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:27:14 2022] GET /compute/v2.1/servers/362a9924-7119-4e2e-bd41-d68a5f545009 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:27:15.389826 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-13506614-9bab-42f6-b889-4adca16e776d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:15.393688 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-13506614-9bab-42f6-b889-4adca16e776d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:15.396586 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-13506614-9bab-42f6-b889-4adca16e776d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:15.397174 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-13506614-9bab-42f6-b889-4adca16e776d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:15.397970 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-13506614-9bab-42f6-b889-4adca16e776d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:15.398404 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-13506614-9bab-42f6-b889-4adca16e776d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:15.411622 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.wsgi [None req-13506614-9bab-42f6-b889-4adca16e776d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] HTTP exception thrown: Instance 9c94150b-0bc5-4635-b761-9f16d6f0b0a2 could not be found. May 10 21:27:15.413148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-13506614-9bab-42f6-b889-4adca16e776d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Request method failure captured: May 10 21:27:15.413148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: request: DELETE /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2 HTTP/1.1 May 10 21:27:15.413148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept: application/json May 10 21:27:15.413148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept-Encoding: identity May 10 21:27:15.413148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Connection: close May 10 21:27:15.413148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Length: 0 May 10 21:27:15.413148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Type: application/json May 10 21:27:15.413148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Host: 10.222.0.25 May 10 21:27:15.413148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Openstack-System-Scope: None May 10 21:27:15.413148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: User-Agent: python-urllib3/1.26.9 May 10 21:27:15.413148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Auth-Token: gAAAAABietccfViYRiOQpEa4ldvOHZyUgOQ2ZBBatS9SA20GCDt_AgmFvo4vE33WkYc6oqnMaRFSIYJbwKR_AxZ5OfoHdxsDJwPaySjCJQ5rrDhZmJbbtmsjCkN_RYEyYX6qvdoHvFk_bXj7SkSAx705IP0l1sxFz6bBTFTgIB8EAyrOf7pHKV8 May 10 21:27:15.413148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Id: None May 10 21:27:15.413148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Name: None May 10 21:27:15.413148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Identity-Status: Confirmed May 10 21:27:15.413148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Is-Admin-Project: True May 10 21:27:15.413148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Id: default May 10 21:27:15.413148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Name: Default May 10 21:27:15.413148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Id: 8286226c580f4896aec72c65642fce30 May 10 21:27:15.413148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Name: tempest-AttachVolumeNegativeTest-1863330069 May 10 21:27:15.413148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Role: member,reader May 10 21:27:15.413148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Roles: member,reader May 10 21:27:15.417966 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8286226c580f4896aec72c65642fce30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8286226c580f4896aec72c65642fce30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8286226c580f4896aec72c65642fce30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8286226c580f4896aec72c65642fce30"}]}] May 10 21:27:15.417966 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant: tempest-AttachVolumeNegativeTest-1863330069 May 10 21:27:15.417966 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Id: 8286226c580f4896aec72c65642fce30 May 10 21:27:15.417966 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1863330069 May 10 21:27:15.417966 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User: tempest-AttachVolumeNegativeTest-1863330069-project May 10 21:27:15.417966 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Id: default May 10 21:27:15.417966 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Name: Default May 10 21:27:15.417966 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Id: ca39678abe6e476283f94c675d4ea369 May 10 21:27:15.417966 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Name: tempest-AttachVolumeNegativeTest-1863330069-project May 10 21:27:15.417966 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: method: > May 10 21:27:15.417966 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: exception: Instance 9c94150b-0bc5-4635-b761-9f16d6f0b0a2 could not be found. May 10 21:27:15.417966 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: action_args: {'id': '9c94150b-0bc5-4635-b761-9f16d6f0b0a2'} May 10 21:27:15.418942 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:27:15.418942 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:27:15.418942 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:27:15.418942 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:27:15.418942 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:27:15.418942 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:27:15.418942 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:27:15.418942 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:27:15.418942 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:27:15.418942 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:27:15.418942 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c94150b-0bc5-4635-b761-9f16d6f0b0a2 could not be found. May 10 21:27:15.418942 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:27:15.418942 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:27:15.418942 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:27:15.418942 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:27:15.418942 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:27:15.418942 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:27:15.418942 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:27:15.418942 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:27:15.418942 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:27:15.420380 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:27:15.420380 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 21:27:15.420380 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 21:27:15.420380 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 21:27:15.420380 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 21:27:15.420380 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:27:15.420380 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:27:15.420380 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:27:15.420380 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:27:15.420380 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c94150b-0bc5-4635-b761-9f16d6f0b0a2 could not be found. May 10 21:27:15.420380 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:27:15.420380 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:27:15.420380 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:27:15.420380 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:27:15.420380 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:27:15.420380 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:27:15.420380 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:27:15.420380 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:27:15.420380 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c94150b-0bc5-4635-b761-9f16d6f0b0a2 could not be found. May 10 21:27:15.420380 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:27:15.421888 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-13506614-9bab-42f6-b889-4adca16e776d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Returning 404 to user: Instance 9c94150b-0bc5-4635-b761-9f16d6f0b0a2 could not be found. {{(pid=117678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:27:15.421888 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-13506614-9bab-42f6-b889-4adca16e776d tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2" status: 404 len: 111 microversion: 2.1 time: 0.028609 May 10 21:27:15.421888 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 420/839] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 10 21:27:15 2022] DELETE /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:27:15.422860 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-760797c4-e354-4ef2-9915-ab4a7760fa78 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:15.423526 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-760797c4-e354-4ef2-9915-ab4a7760fa78 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] [instance: 9c94150b-0bc5-4635-b761-9f16d6f0b0a2] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:15.430864 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-760797c4-e354-4ef2-9915-ab4a7760fa78 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:15.431306 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-760797c4-e354-4ef2-9915-ab4a7760fa78 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:15.432097 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-760797c4-e354-4ef2-9915-ab4a7760fa78 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:15.432499 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-760797c4-e354-4ef2-9915-ab4a7760fa78 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:15.446407 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-760797c4-e354-4ef2-9915-ab4a7760fa78 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] HTTP exception thrown: Instance 9c94150b-0bc5-4635-b761-9f16d6f0b0a2 could not be found. May 10 21:27:15.447926 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-760797c4-e354-4ef2-9915-ab4a7760fa78 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Request method failure captured: May 10 21:27:15.447926 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: request: GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2 HTTP/1.1 May 10 21:27:15.447926 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept: application/json May 10 21:27:15.447926 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity May 10 21:27:15.447926 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Connection: close May 10 21:27:15.447926 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Length: 0 May 10 21:27:15.447926 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Type: application/json May 10 21:27:15.447926 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Host: 10.222.0.25 May 10 21:27:15.447926 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None May 10 21:27:15.447926 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 May 10 21:27:15.447926 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABietccfViYRiOQpEa4ldvOHZyUgOQ2ZBBatS9SA20GCDt_AgmFvo4vE33WkYc6oqnMaRFSIYJbwKR_AxZ5OfoHdxsDJwPaySjCJQ5rrDhZmJbbtmsjCkN_RYEyYX6qvdoHvFk_bXj7SkSAx705IP0l1sxFz6bBTFTgIB8EAyrOf7pHKV8 May 10 21:27:15.447926 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Id: None May 10 21:27:15.447926 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Name: None May 10 21:27:15.447926 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed May 10 21:27:15.447926 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True May 10 21:27:15.447926 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default May 10 21:27:15.447926 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default May 10 21:27:15.447926 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Id: 8286226c580f4896aec72c65642fce30 May 10 21:27:15.447926 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-AttachVolumeNegativeTest-1863330069 May 10 21:27:15.447926 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Role: member,reader May 10 21:27:15.447926 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Roles: member,reader May 10 21:27:15.449613 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8286226c580f4896aec72c65642fce30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8286226c580f4896aec72c65642fce30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8286226c580f4896aec72c65642fce30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8286226c580f4896aec72c65642fce30"}]}] May 10 21:27:15.449613 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-AttachVolumeNegativeTest-1863330069 May 10 21:27:15.449613 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Id: 8286226c580f4896aec72c65642fce30 May 10 21:27:15.449613 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1863330069 May 10 21:27:15.449613 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User: tempest-AttachVolumeNegativeTest-1863330069-project May 10 21:27:15.449613 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default May 10 21:27:15.449613 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default May 10 21:27:15.449613 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Id: ca39678abe6e476283f94c675d4ea369 May 10 21:27:15.449613 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-AttachVolumeNegativeTest-1863330069-project May 10 21:27:15.449613 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: method: > May 10 21:27:15.449613 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: exception: Instance 9c94150b-0bc5-4635-b761-9f16d6f0b0a2 could not be found. May 10 21:27:15.449613 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: action_args: {'id': '9c94150b-0bc5-4635-b761-9f16d6f0b0a2'} May 10 21:27:15.450637 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:27:15.450637 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:27:15.450637 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:27:15.450637 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:27:15.450637 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:27:15.450637 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:27:15.450637 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:27:15.450637 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:27:15.450637 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:27:15.450637 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:27:15.450637 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c94150b-0bc5-4635-b761-9f16d6f0b0a2 could not be found. May 10 21:27:15.450637 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:27:15.450637 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:27:15.450637 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:27:15.450637 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:27:15.450637 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:27:15.450637 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:27:15.450637 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:27:15.450637 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:27:15.450637 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:27:15.452100 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:27:15.452100 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:27:15.452100 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:27:15.452100 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:27:15.452100 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:27:15.452100 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:27:15.452100 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:27:15.452100 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c94150b-0bc5-4635-b761-9f16d6f0b0a2 could not be found. May 10 21:27:15.452100 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:27:15.452100 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:27:15.452100 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:27:15.452100 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:27:15.452100 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:27:15.452100 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:27:15.452100 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:27:15.452100 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:27:15.452100 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c94150b-0bc5-4635-b761-9f16d6f0b0a2 could not be found. May 10 21:27:15.452100 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:27:15.453457 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-760797c4-e354-4ef2-9915-ab4a7760fa78 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] Returning 404 to user: Instance 9c94150b-0bc5-4635-b761-9f16d6f0b0a2 could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:27:15.453457 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-760797c4-e354-4ef2-9915-ab4a7760fa78 tempest-AttachVolumeNegativeTest-1863330069 tempest-AttachVolumeNegativeTest-1863330069-project] 10.222.0.25 "GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2" status: 404 len: 111 microversion: 2.1 time: 0.030213 May 10 21:27:15.453457 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 420/840] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:27:15 2022] GET /compute/v2.1/servers/9c94150b-0bc5-4635-b761-9f16d6f0b0a2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:27:26.578337 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-e86ed2bd-1c3c-4637-977d-98c9bc30020d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:26.579284 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-e86ed2bd-1c3c-4637-977d-98c9bc30020d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:26.586218 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e86ed2bd-1c3c-4637-977d-98c9bc30020d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:26.586694 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e86ed2bd-1c3c-4637-977d-98c9bc30020d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:26.587664 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e86ed2bd-1c3c-4637-977d-98c9bc30020d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:26.588087 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e86ed2bd-1c3c-4637-977d-98c9bc30020d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:26.617648 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-e86ed2bd-1c3c-4637-977d-98c9bc30020d tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043030 May 10 21:27:26.618214 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 421/841] 10.222.0.25 () {60 vars in 1342 bytes} [Tue May 10 21:27:26 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:26.676840 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-74b842af-e8f5-4ed8-9869-4bee2772a317 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:26.680254 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-74b842af-e8f5-4ed8-9869-4bee2772a317 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:26.683862 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-74b842af-e8f5-4ed8-9869-4bee2772a317 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:26.684312 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-74b842af-e8f5-4ed8-9869-4bee2772a317 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:26.685079 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-74b842af-e8f5-4ed8-9869-4bee2772a317 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:26.685514 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-74b842af-e8f5-4ed8-9869-4bee2772a317 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:26.710080 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-74b842af-e8f5-4ed8-9869-4bee2772a317 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Going to try to terminate instance {{(pid=117679) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 21:27:26.966166 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-74b842af-e8f5-4ed8-9869-4bee2772a317 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 204 len: 0 microversion: 2.20 time: 0.292926 May 10 21:27:26.966815 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 421/842] 10.222.0.25 () {60 vars in 1279 bytes} [Tue May 10 21:27:26 2022] DELETE /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 21:27:26.981564 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-41ad53ae-d03e-44a1-aa5a-3560b897fbd2 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:26.982192 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-41ad53ae-d03e-44a1-aa5a-3560b897fbd2 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:26.988361 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-41ad53ae-d03e-44a1-aa5a-3560b897fbd2 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:26.988808 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-41ad53ae-d03e-44a1-aa5a-3560b897fbd2 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:26.989562 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-41ad53ae-d03e-44a1-aa5a-3560b897fbd2 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:26.989990 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-41ad53ae-d03e-44a1-aa5a-3560b897fbd2 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:27.128749 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-41ad53ae-d03e-44a1-aa5a-3560b897fbd2 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:27.138905 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-41ad53ae-d03e-44a1-aa5a-3560b897fbd2 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:27.140411 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-41ad53ae-d03e-44a1-aa5a-3560b897fbd2 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:27.141581 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-41ad53ae-d03e-44a1-aa5a-3560b897fbd2 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1724 microversion: 2.20 time: 0.164211 May 10 21:27:27.142335 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 422/843] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:27:26 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:27:28.161743 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-77af3f78-af8a-43ba-9d13-93e2ea28d2b4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:28.162485 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-77af3f78-af8a-43ba-9d13-93e2ea28d2b4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:28.169694 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-77af3f78-af8a-43ba-9d13-93e2ea28d2b4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:28.170209 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-77af3f78-af8a-43ba-9d13-93e2ea28d2b4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:28.170926 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-77af3f78-af8a-43ba-9d13-93e2ea28d2b4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:28.171366 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-77af3f78-af8a-43ba-9d13-93e2ea28d2b4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:28.374893 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-77af3f78-af8a-43ba-9d13-93e2ea28d2b4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:28.383138 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-77af3f78-af8a-43ba-9d13-93e2ea28d2b4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:28.420009 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-77af3f78-af8a-43ba-9d13-93e2ea28d2b4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:28.420009 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-77af3f78-af8a-43ba-9d13-93e2ea28d2b4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1724 microversion: 2.20 time: 0.228555 May 10 21:27:28.420009 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 422/844] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:27:28 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:27:29.404482 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-d841ffb0-3be9-4b18-a928-df500d034c1b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:29.405093 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-d841ffb0-3be9-4b18-a928-df500d034c1b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:29.411442 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d841ffb0-3be9-4b18-a928-df500d034c1b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:29.412188 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d841ffb0-3be9-4b18-a928-df500d034c1b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:29.412826 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d841ffb0-3be9-4b18-a928-df500d034c1b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:29.413258 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d841ffb0-3be9-4b18-a928-df500d034c1b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:29.483117 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-768534a3-28cb-4737-b4af-4310b40312dc req-15b020f1-391b-438e-bd15-38c8973e47c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f31bca91-29e8-4a4c-ba97-7e4c993502ef", "name": "network-vif-deleted", "tag": "53eb87d9-7496-49b6-b83d-932f96780089"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:27:29.484238 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-d841ffb0-3be9-4b18-a928-df500d034c1b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:29.491131 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-768534a3-28cb-4737-b4af-4310b40312dc req-15b020f1-391b-438e-bd15-38c8973e47c1 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:29.491565 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-768534a3-28cb-4737-b4af-4310b40312dc req-15b020f1-391b-438e-bd15-38c8973e47c1 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:29.493722 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-d841ffb0-3be9-4b18-a928-df500d034c1b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:29.495482 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-d841ffb0-3be9-4b18-a928-df500d034c1b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2267b0c3311480eb8d1f54df5296c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802e2ef29f6f4b2c8ca69204b69cc142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:29.500356 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-d841ffb0-3be9-4b18-a928-df500d034c1b tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 200 len: 1656 microversion: 2.20 time: 0.096237 May 10 21:27:29.500356 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 423/845] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:27:29 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 1656 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:27:29.503652 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-768534a3-28cb-4737-b4af-4310b40312dc req-15b020f1-391b-438e-bd15-38c8973e47c1 service nova] Creating event network-vif-deleted:53eb87d9-7496-49b6-b83d-932f96780089 for instance f31bca91-29e8-4a4c-ba97-7e4c993502ef on hv-cinder-83608 May 10 21:27:29.509407 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-768534a3-28cb-4737-b4af-4310b40312dc req-15b020f1-391b-438e-bd15-38c8973e47c1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029839 May 10 21:27:29.510000 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 423/846] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:27:30.516439 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-b4b38e7a-fc6b-49f9-8f07-2f5ec8bcf3f9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:30.517212 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-b4b38e7a-fc6b-49f9-8f07-2f5ec8bcf3f9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:30.524654 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b4b38e7a-fc6b-49f9-8f07-2f5ec8bcf3f9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:30.525224 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b4b38e7a-fc6b-49f9-8f07-2f5ec8bcf3f9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:30.526085 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b4b38e7a-fc6b-49f9-8f07-2f5ec8bcf3f9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:30.527053 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b4b38e7a-fc6b-49f9-8f07-2f5ec8bcf3f9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:30.542299 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.wsgi [None req-b4b38e7a-fc6b-49f9-8f07-2f5ec8bcf3f9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] HTTP exception thrown: Instance f31bca91-29e8-4a4c-ba97-7e4c993502ef could not be found. May 10 21:27:30.543971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-b4b38e7a-fc6b-49f9-8f07-2f5ec8bcf3f9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Request method failure captured: May 10 21:27:30.543971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: request: GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef HTTP/1.1 May 10 21:27:30.543971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept: application/json May 10 21:27:30.543971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept-Encoding: identity May 10 21:27:30.543971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Connection: close May 10 21:27:30.543971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Length: 0 May 10 21:27:30.543971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Type: application/json May 10 21:27:30.543971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Host: 10.222.0.25 May 10 21:27:30.543971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Openstack-System-Scope: None May 10 21:27:30.543971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: User-Agent: python-urllib3/1.26.9 May 10 21:27:30.543971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Auth-Token: gAAAAABietcfe6lMeI8-tGr-6bZXprKhi7Y65KdAEgIkIrPxMDTWh3KcswzlZ_JOKGUeGCbiaxdNeo01Bu4eTUznNFUCVsrw5fiiJio5O_H1b9vjdbI5TidmADrY3b1ZIBtthDKQXf5C4AptPGAjqEBECYCxJC4JzhtcpaiOtPRTbGJHAPt3tCU May 10 21:27:30.543971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Id: None May 10 21:27:30.543971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Name: None May 10 21:27:30.543971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Identity-Status: Confirmed May 10 21:27:30.543971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Is-Admin-Project: True May 10 21:27:30.543971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Openstack-Nova-Api-Version: 2.20 May 10 21:27:30.543971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Id: default May 10 21:27:30.543971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Name: Default May 10 21:27:30.543971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Id: 802e2ef29f6f4b2c8ca69204b69cc142 May 10 21:27:30.543971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-31474631 May 10 21:27:30.543971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Role: member,reader May 10 21:27:30.543971 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Roles: member,reader May 10 21:27:30.545516 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/802e2ef29f6f4b2c8ca69204b69cc142"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_802e2ef29f6f4b2c8ca69204b69cc142"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/802e2ef29f6f4b2c8ca69204b69cc142"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/802e2ef29f6f4b2c8ca69204b69cc142"}]}] May 10 21:27:30.545516 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant: tempest-AttachVolumeShelveTestJSON-31474631 May 10 21:27:30.545516 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Id: 802e2ef29f6f4b2c8ca69204b69cc142 May 10 21:27:30.545516 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-31474631 May 10 21:27:30.545516 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User: tempest-AttachVolumeShelveTestJSON-31474631-project May 10 21:27:30.545516 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Id: default May 10 21:27:30.545516 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Name: Default May 10 21:27:30.545516 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Id: d2267b0c3311480eb8d1f54df5296c4c May 10 21:27:30.545516 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Name: tempest-AttachVolumeShelveTestJSON-31474631-project May 10 21:27:30.545516 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: method: > May 10 21:27:30.545516 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: exception: Instance f31bca91-29e8-4a4c-ba97-7e4c993502ef could not be found. May 10 21:27:30.545516 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: action_args: {'id': 'f31bca91-29e8-4a4c-ba97-7e4c993502ef'} May 10 21:27:30.546279 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:27:30.546279 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:27:30.546279 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:27:30.546279 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:27:30.546279 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:27:30.546279 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:27:30.546279 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:27:30.546279 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:27:30.546279 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:27:30.546279 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:27:30.546279 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f31bca91-29e8-4a4c-ba97-7e4c993502ef could not be found. May 10 21:27:30.546279 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:27:30.546279 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:27:30.546279 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:27:30.546279 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:27:30.546279 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:27:30.546279 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:27:30.546279 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:27:30.546279 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:27:30.546279 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:27:30.547518 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:27:30.547518 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:27:30.547518 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:27:30.547518 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:27:30.547518 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:27:30.547518 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:27:30.547518 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:27:30.547518 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f31bca91-29e8-4a4c-ba97-7e4c993502ef could not be found. May 10 21:27:30.547518 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:27:30.547518 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:27:30.547518 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:27:30.547518 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:27:30.547518 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:27:30.547518 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:27:30.547518 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:27:30.547518 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:27:30.547518 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f31bca91-29e8-4a4c-ba97-7e4c993502ef could not be found. May 10 21:27:30.547518 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:27:30.548603 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-b4b38e7a-fc6b-49f9-8f07-2f5ec8bcf3f9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Returning 404 to user: Instance f31bca91-29e8-4a4c-ba97-7e4c993502ef could not be found. {{(pid=117678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:27:30.548603 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-b4b38e7a-fc6b-49f9-8f07-2f5ec8bcf3f9 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 404 len: 111 microversion: 2.20 time: 0.033320 May 10 21:27:30.548603 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 424/847] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:27:30 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 21:27:30.556315 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-3e085897-012c-4ce2-a92f-88e3ea3f5299 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '.version_select at 0x7f7aef5bf8b0>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:30.630116 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-3e085897-012c-4ce2-a92f-88e3ea3f5299 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-218098278" status: 204 len: 0 microversion: 2.20 time: 0.079221 May 10 21:27:30.630772 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 424/848] 10.222.0.25 () {60 vars in 1258 bytes} [Tue May 10 21:27:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-218098278 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 21:27:32.737659 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-09623962-fa91-42a1-97e0-c06f8e2715ad tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:32.738622 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-09623962-fa91-42a1-97e0-c06f8e2715ad tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:32.744618 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-09623962-fa91-42a1-97e0-c06f8e2715ad tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:32.745067 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-09623962-fa91-42a1-97e0-c06f8e2715ad tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:32.745843 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-09623962-fa91-42a1-97e0-c06f8e2715ad tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:32.746277 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-09623962-fa91-42a1-97e0-c06f8e2715ad tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:32.759776 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.wsgi [None req-09623962-fa91-42a1-97e0-c06f8e2715ad tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] HTTP exception thrown: Instance f31bca91-29e8-4a4c-ba97-7e4c993502ef could not be found. May 10 21:27:32.761585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-09623962-fa91-42a1-97e0-c06f8e2715ad tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Request method failure captured: May 10 21:27:32.761585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: request: DELETE /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef HTTP/1.1 May 10 21:27:32.761585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept: application/json May 10 21:27:32.761585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept-Encoding: identity May 10 21:27:32.761585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Connection: close May 10 21:27:32.761585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Length: 0 May 10 21:27:32.761585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Type: application/json May 10 21:27:32.761585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Host: 10.222.0.25 May 10 21:27:32.761585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Openstack-System-Scope: None May 10 21:27:32.761585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: User-Agent: python-urllib3/1.26.9 May 10 21:27:32.761585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Auth-Token: gAAAAABietcfe6lMeI8-tGr-6bZXprKhi7Y65KdAEgIkIrPxMDTWh3KcswzlZ_JOKGUeGCbiaxdNeo01Bu4eTUznNFUCVsrw5fiiJio5O_H1b9vjdbI5TidmADrY3b1ZIBtthDKQXf5C4AptPGAjqEBECYCxJC4JzhtcpaiOtPRTbGJHAPt3tCU May 10 21:27:32.761585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Id: None May 10 21:27:32.761585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Name: None May 10 21:27:32.761585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Identity-Status: Confirmed May 10 21:27:32.761585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Is-Admin-Project: True May 10 21:27:32.761585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Openstack-Nova-Api-Version: 2.20 May 10 21:27:32.761585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Id: default May 10 21:27:32.761585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Name: Default May 10 21:27:32.761585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Id: 802e2ef29f6f4b2c8ca69204b69cc142 May 10 21:27:32.761585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-31474631 May 10 21:27:32.761585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Role: member,reader May 10 21:27:32.761585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Roles: member,reader May 10 21:27:32.763434 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/802e2ef29f6f4b2c8ca69204b69cc142"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_802e2ef29f6f4b2c8ca69204b69cc142"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/802e2ef29f6f4b2c8ca69204b69cc142"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/802e2ef29f6f4b2c8ca69204b69cc142"}]}] May 10 21:27:32.763434 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant: tempest-AttachVolumeShelveTestJSON-31474631 May 10 21:27:32.763434 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Id: 802e2ef29f6f4b2c8ca69204b69cc142 May 10 21:27:32.763434 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-31474631 May 10 21:27:32.763434 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User: tempest-AttachVolumeShelveTestJSON-31474631-project May 10 21:27:32.763434 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Id: default May 10 21:27:32.763434 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Name: Default May 10 21:27:32.763434 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Id: d2267b0c3311480eb8d1f54df5296c4c May 10 21:27:32.763434 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Name: tempest-AttachVolumeShelveTestJSON-31474631-project May 10 21:27:32.763434 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: method: > May 10 21:27:32.763434 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: exception: Instance f31bca91-29e8-4a4c-ba97-7e4c993502ef could not be found. May 10 21:27:32.763434 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: action_args: {'id': 'f31bca91-29e8-4a4c-ba97-7e4c993502ef'} May 10 21:27:32.764339 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:27:32.764339 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:27:32.764339 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:27:32.764339 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:27:32.764339 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:27:32.764339 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:27:32.764339 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:27:32.764339 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:27:32.764339 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:27:32.764339 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:27:32.764339 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f31bca91-29e8-4a4c-ba97-7e4c993502ef could not be found. May 10 21:27:32.764339 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:27:32.764339 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:27:32.764339 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:27:32.764339 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:27:32.764339 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:27:32.764339 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:27:32.764339 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:27:32.764339 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:27:32.764339 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:27:32.765963 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:27:32.765963 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 21:27:32.765963 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 21:27:32.765963 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 21:27:32.765963 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 21:27:32.765963 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:27:32.765963 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:27:32.765963 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:27:32.765963 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:27:32.765963 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f31bca91-29e8-4a4c-ba97-7e4c993502ef could not be found. May 10 21:27:32.765963 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:27:32.765963 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:27:32.765963 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:27:32.765963 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:27:32.765963 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:27:32.765963 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:27:32.765963 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:27:32.765963 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:27:32.765963 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f31bca91-29e8-4a4c-ba97-7e4c993502ef could not be found. May 10 21:27:32.765963 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:27:32.767826 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-09623962-fa91-42a1-97e0-c06f8e2715ad tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Returning 404 to user: Instance f31bca91-29e8-4a4c-ba97-7e4c993502ef could not be found. {{(pid=117678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:27:32.767826 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-09623962-fa91-42a1-97e0-c06f8e2715ad tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 404 len: 111 microversion: 2.20 time: 0.029230 May 10 21:27:32.767826 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 425/849] 10.222.0.25 () {60 vars in 1279 bytes} [Tue May 10 21:27:32 2022] DELETE /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 10 21:27:32.771949 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-3ebbfd08-f8f3-4a40-9834-33146abb24f4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:32.772708 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-3ebbfd08-f8f3-4a40-9834-33146abb24f4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: f31bca91-29e8-4a4c-ba97-7e4c993502ef] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:32.780533 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3ebbfd08-f8f3-4a40-9834-33146abb24f4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:32.787706 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3ebbfd08-f8f3-4a40-9834-33146abb24f4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:32.787706 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3ebbfd08-f8f3-4a40-9834-33146abb24f4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:32.787706 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3ebbfd08-f8f3-4a40-9834-33146abb24f4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:32.803090 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-3ebbfd08-f8f3-4a40-9834-33146abb24f4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] HTTP exception thrown: Instance f31bca91-29e8-4a4c-ba97-7e4c993502ef could not be found. May 10 21:27:32.804752 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-3ebbfd08-f8f3-4a40-9834-33146abb24f4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Request method failure captured: May 10 21:27:32.804752 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: request: GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef HTTP/1.1 May 10 21:27:32.804752 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept: application/json May 10 21:27:32.804752 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity May 10 21:27:32.804752 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Connection: close May 10 21:27:32.804752 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Length: 0 May 10 21:27:32.804752 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Type: application/json May 10 21:27:32.804752 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Host: 10.222.0.25 May 10 21:27:32.804752 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None May 10 21:27:32.804752 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 May 10 21:27:32.804752 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABietcfe6lMeI8-tGr-6bZXprKhi7Y65KdAEgIkIrPxMDTWh3KcswzlZ_JOKGUeGCbiaxdNeo01Bu4eTUznNFUCVsrw5fiiJio5O_H1b9vjdbI5TidmADrY3b1ZIBtthDKQXf5C4AptPGAjqEBECYCxJC4JzhtcpaiOtPRTbGJHAPt3tCU May 10 21:27:32.804752 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Id: None May 10 21:27:32.804752 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Name: None May 10 21:27:32.804752 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed May 10 21:27:32.804752 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True May 10 21:27:32.804752 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Openstack-Nova-Api-Version: 2.20 May 10 21:27:32.804752 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default May 10 21:27:32.804752 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default May 10 21:27:32.804752 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Id: 802e2ef29f6f4b2c8ca69204b69cc142 May 10 21:27:32.804752 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-31474631 May 10 21:27:32.804752 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Role: member,reader May 10 21:27:32.804752 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Roles: member,reader May 10 21:27:32.806417 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/802e2ef29f6f4b2c8ca69204b69cc142"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_802e2ef29f6f4b2c8ca69204b69cc142"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/802e2ef29f6f4b2c8ca69204b69cc142"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/802e2ef29f6f4b2c8ca69204b69cc142"}]}] May 10 21:27:32.806417 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-AttachVolumeShelveTestJSON-31474631 May 10 21:27:32.806417 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Id: 802e2ef29f6f4b2c8ca69204b69cc142 May 10 21:27:32.806417 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-31474631 May 10 21:27:32.806417 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User: tempest-AttachVolumeShelveTestJSON-31474631-project May 10 21:27:32.806417 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default May 10 21:27:32.806417 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default May 10 21:27:32.806417 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Id: d2267b0c3311480eb8d1f54df5296c4c May 10 21:27:32.806417 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-AttachVolumeShelveTestJSON-31474631-project May 10 21:27:32.806417 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: method: > May 10 21:27:32.806417 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: exception: Instance f31bca91-29e8-4a4c-ba97-7e4c993502ef could not be found. May 10 21:27:32.806417 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: action_args: {'id': 'f31bca91-29e8-4a4c-ba97-7e4c993502ef'} May 10 21:27:32.807255 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:27:32.807255 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:27:32.807255 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:27:32.807255 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:27:32.807255 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:27:32.807255 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:27:32.807255 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:27:32.807255 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:27:32.807255 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:27:32.807255 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:27:32.807255 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f31bca91-29e8-4a4c-ba97-7e4c993502ef could not be found. May 10 21:27:32.807255 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:27:32.807255 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:27:32.807255 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:27:32.807255 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:27:32.807255 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:27:32.807255 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:27:32.807255 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:27:32.807255 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:27:32.807255 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:27:32.808531 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:27:32.808531 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:27:32.808531 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:27:32.808531 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:27:32.808531 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:27:32.808531 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:27:32.808531 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:27:32.808531 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f31bca91-29e8-4a4c-ba97-7e4c993502ef could not be found. May 10 21:27:32.808531 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:27:32.808531 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:27:32.808531 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:27:32.808531 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:27:32.808531 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:27:32.808531 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:27:32.808531 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:27:32.808531 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:27:32.808531 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f31bca91-29e8-4a4c-ba97-7e4c993502ef could not be found. May 10 21:27:32.808531 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:27:32.809661 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-3ebbfd08-f8f3-4a40-9834-33146abb24f4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Returning 404 to user: Instance f31bca91-29e8-4a4c-ba97-7e4c993502ef could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:27:32.809661 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-3ebbfd08-f8f3-4a40-9834-33146abb24f4 tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef" status: 404 len: 111 microversion: 2.20 time: 0.038544 May 10 21:27:32.809661 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 425/850] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:27:32 2022] GET /compute/v2.1/servers/f31bca91-29e8-4a4c-ba97-7e4c993502ef => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 21:27:34.090780 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-bf042e16-3102-4b98-a3a0-b453f937aacf tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:34.091405 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-bf042e16-3102-4b98-a3a0-b453f937aacf tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:34.098068 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-bf042e16-3102-4b98-a3a0-b453f937aacf tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:34.098630 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-bf042e16-3102-4b98-a3a0-b453f937aacf tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:34.099390 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-bf042e16-3102-4b98-a3a0-b453f937aacf tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:34.099875 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-bf042e16-3102-4b98-a3a0-b453f937aacf tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:34.114719 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.wsgi [None req-bf042e16-3102-4b98-a3a0-b453f937aacf tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] HTTP exception thrown: Instance ef19cfc2-aeb2-40ff-b25c-187304690869 could not be found. May 10 21:27:34.116304 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-bf042e16-3102-4b98-a3a0-b453f937aacf tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Request method failure captured: May 10 21:27:34.116304 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: request: DELETE /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 HTTP/1.1 May 10 21:27:34.116304 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept: application/json May 10 21:27:34.116304 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept-Encoding: identity May 10 21:27:34.116304 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Connection: close May 10 21:27:34.116304 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Length: 0 May 10 21:27:34.116304 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Type: application/json May 10 21:27:34.116304 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Host: 10.222.0.25 May 10 21:27:34.116304 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Openstack-System-Scope: None May 10 21:27:34.116304 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: User-Agent: python-urllib3/1.26.9 May 10 21:27:34.116304 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Auth-Token: gAAAAABietcfe6lMeI8-tGr-6bZXprKhi7Y65KdAEgIkIrPxMDTWh3KcswzlZ_JOKGUeGCbiaxdNeo01Bu4eTUznNFUCVsrw5fiiJio5O_H1b9vjdbI5TidmADrY3b1ZIBtthDKQXf5C4AptPGAjqEBECYCxJC4JzhtcpaiOtPRTbGJHAPt3tCU May 10 21:27:34.116304 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Id: None May 10 21:27:34.116304 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Name: None May 10 21:27:34.116304 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Identity-Status: Confirmed May 10 21:27:34.116304 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Is-Admin-Project: True May 10 21:27:34.116304 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Openstack-Nova-Api-Version: 2.20 May 10 21:27:34.116304 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Id: default May 10 21:27:34.116304 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Name: Default May 10 21:27:34.116304 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Id: 802e2ef29f6f4b2c8ca69204b69cc142 May 10 21:27:34.116304 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-31474631 May 10 21:27:34.116304 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Role: member,reader May 10 21:27:34.116304 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Roles: member,reader May 10 21:27:34.118649 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/802e2ef29f6f4b2c8ca69204b69cc142"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_802e2ef29f6f4b2c8ca69204b69cc142"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/802e2ef29f6f4b2c8ca69204b69cc142"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/802e2ef29f6f4b2c8ca69204b69cc142"}]}] May 10 21:27:34.118649 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant: tempest-AttachVolumeShelveTestJSON-31474631 May 10 21:27:34.118649 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Id: 802e2ef29f6f4b2c8ca69204b69cc142 May 10 21:27:34.118649 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-31474631 May 10 21:27:34.118649 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User: tempest-AttachVolumeShelveTestJSON-31474631-project May 10 21:27:34.118649 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Id: default May 10 21:27:34.118649 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Name: Default May 10 21:27:34.118649 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Id: d2267b0c3311480eb8d1f54df5296c4c May 10 21:27:34.118649 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Name: tempest-AttachVolumeShelveTestJSON-31474631-project May 10 21:27:34.118649 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: method: > May 10 21:27:34.118649 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: exception: Instance ef19cfc2-aeb2-40ff-b25c-187304690869 could not be found. May 10 21:27:34.118649 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: action_args: {'id': 'ef19cfc2-aeb2-40ff-b25c-187304690869'} May 10 21:27:34.119907 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:27:34.119907 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:27:34.119907 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:27:34.119907 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:27:34.119907 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:27:34.119907 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:27:34.119907 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:27:34.119907 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:27:34.119907 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:27:34.119907 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:27:34.119907 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef19cfc2-aeb2-40ff-b25c-187304690869 could not be found. May 10 21:27:34.119907 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:27:34.119907 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:27:34.119907 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:27:34.119907 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:27:34.119907 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:27:34.119907 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:27:34.119907 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:27:34.119907 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:27:34.119907 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:27:34.121524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:27:34.121524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 21:27:34.121524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 21:27:34.121524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 21:27:34.121524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 21:27:34.121524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:27:34.121524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:27:34.121524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:27:34.121524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:27:34.121524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef19cfc2-aeb2-40ff-b25c-187304690869 could not be found. May 10 21:27:34.121524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:27:34.121524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:27:34.121524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:27:34.121524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:27:34.121524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:27:34.121524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:27:34.121524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:27:34.121524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:27:34.121524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef19cfc2-aeb2-40ff-b25c-187304690869 could not be found. May 10 21:27:34.121524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:27:34.123041 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-bf042e16-3102-4b98-a3a0-b453f937aacf tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Returning 404 to user: Instance ef19cfc2-aeb2-40ff-b25c-187304690869 could not be found. {{(pid=117678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:27:34.123041 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-bf042e16-3102-4b98-a3a0-b453f937aacf tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 404 len: 111 microversion: 2.20 time: 0.032036 May 10 21:27:34.123041 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 426/851] 10.222.0.25 () {60 vars in 1279 bytes} [Tue May 10 21:27:34 2022] DELETE /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 21:27:34.128206 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-0774dce8-1025-437f-8248-93866bfaf87f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:34.128819 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-0774dce8-1025-437f-8248-93866bfaf87f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] [instance: ef19cfc2-aeb2-40ff-b25c-187304690869] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:34.136293 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0774dce8-1025-437f-8248-93866bfaf87f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:34.136741 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0774dce8-1025-437f-8248-93866bfaf87f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:34.137509 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0774dce8-1025-437f-8248-93866bfaf87f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:34.137996 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0774dce8-1025-437f-8248-93866bfaf87f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:34.152528 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-0774dce8-1025-437f-8248-93866bfaf87f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] HTTP exception thrown: Instance ef19cfc2-aeb2-40ff-b25c-187304690869 could not be found. May 10 21:27:34.156369 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-0774dce8-1025-437f-8248-93866bfaf87f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Request method failure captured: May 10 21:27:34.156369 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: request: GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 HTTP/1.1 May 10 21:27:34.156369 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept: application/json May 10 21:27:34.156369 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity May 10 21:27:34.156369 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Connection: close May 10 21:27:34.156369 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Length: 0 May 10 21:27:34.156369 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Type: application/json May 10 21:27:34.156369 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Host: 10.222.0.25 May 10 21:27:34.156369 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None May 10 21:27:34.156369 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 May 10 21:27:34.156369 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABietcfe6lMeI8-tGr-6bZXprKhi7Y65KdAEgIkIrPxMDTWh3KcswzlZ_JOKGUeGCbiaxdNeo01Bu4eTUznNFUCVsrw5fiiJio5O_H1b9vjdbI5TidmADrY3b1ZIBtthDKQXf5C4AptPGAjqEBECYCxJC4JzhtcpaiOtPRTbGJHAPt3tCU May 10 21:27:34.156369 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Id: None May 10 21:27:34.156369 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Name: None May 10 21:27:34.156369 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed May 10 21:27:34.156369 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True May 10 21:27:34.156369 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Openstack-Nova-Api-Version: 2.20 May 10 21:27:34.156369 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default May 10 21:27:34.156369 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default May 10 21:27:34.156369 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Id: 802e2ef29f6f4b2c8ca69204b69cc142 May 10 21:27:34.156369 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-31474631 May 10 21:27:34.156369 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Role: member,reader May 10 21:27:34.156369 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Roles: member,reader May 10 21:27:34.158022 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/802e2ef29f6f4b2c8ca69204b69cc142"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_802e2ef29f6f4b2c8ca69204b69cc142"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/802e2ef29f6f4b2c8ca69204b69cc142"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/802e2ef29f6f4b2c8ca69204b69cc142"}]}] May 10 21:27:34.158022 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-AttachVolumeShelveTestJSON-31474631 May 10 21:27:34.158022 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Id: 802e2ef29f6f4b2c8ca69204b69cc142 May 10 21:27:34.158022 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-31474631 May 10 21:27:34.158022 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User: tempest-AttachVolumeShelveTestJSON-31474631-project May 10 21:27:34.158022 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default May 10 21:27:34.158022 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default May 10 21:27:34.158022 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Id: d2267b0c3311480eb8d1f54df5296c4c May 10 21:27:34.158022 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-AttachVolumeShelveTestJSON-31474631-project May 10 21:27:34.158022 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: method: > May 10 21:27:34.158022 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: exception: Instance ef19cfc2-aeb2-40ff-b25c-187304690869 could not be found. May 10 21:27:34.158022 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: action_args: {'id': 'ef19cfc2-aeb2-40ff-b25c-187304690869'} May 10 21:27:34.159052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:27:34.159052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:27:34.159052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:27:34.159052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:27:34.159052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:27:34.159052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:27:34.159052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:27:34.159052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:27:34.159052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:27:34.159052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:27:34.159052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef19cfc2-aeb2-40ff-b25c-187304690869 could not be found. May 10 21:27:34.159052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:27:34.159052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:27:34.159052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:27:34.159052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:27:34.159052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:27:34.159052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:27:34.159052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:27:34.159052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:27:34.159052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:27:34.160550 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:27:34.160550 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:27:34.160550 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:27:34.160550 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:27:34.160550 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:27:34.160550 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:27:34.160550 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:27:34.160550 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef19cfc2-aeb2-40ff-b25c-187304690869 could not be found. May 10 21:27:34.160550 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:27:34.160550 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:27:34.160550 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:27:34.160550 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:27:34.160550 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:27:34.160550 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:27:34.160550 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:27:34.160550 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:27:34.160550 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef19cfc2-aeb2-40ff-b25c-187304690869 could not be found. May 10 21:27:34.160550 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:27:34.162550 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-0774dce8-1025-437f-8248-93866bfaf87f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] Returning 404 to user: Instance ef19cfc2-aeb2-40ff-b25c-187304690869 could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:27:34.162550 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-0774dce8-1025-437f-8248-93866bfaf87f tempest-AttachVolumeShelveTestJSON-31474631 tempest-AttachVolumeShelveTestJSON-31474631-project] 10.222.0.25 "GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869" status: 404 len: 111 microversion: 2.20 time: 0.031215 May 10 21:27:34.162550 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 426/852] 10.222.0.25 () {60 vars in 1276 bytes} [Tue May 10 21:27:34 2022] GET /compute/v2.1/servers/ef19cfc2-aeb2-40ff-b25c-187304690869 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 21:27:41.919749 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-aa8a4c98-e43c-4378-bab6-d98b49e9fb11 tempest-VolumesTestJSON-715336782 tempest-VolumesTestJSON-715336782-project] Calling method '.version_select at 0x7f7aea255d30>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:41.968605 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-aa8a4c98-e43c-4378-bab6-d98b49e9fb11 tempest-VolumesTestJSON-715336782 tempest-VolumesTestJSON-715336782-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/1a94148c-5a1f-4ac6-a5b7-094a24d6758f" status: 200 len: 351 microversion: 2.1 time: 0.049814 May 10 21:27:41.968605 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 427/853] 10.222.0.25 () {58 vars in 1244 bytes} [Tue May 10 21:27:41 2022] GET /compute/v2.1/os-volumes/1a94148c-5a1f-4ac6-a5b7-094a24d6758f => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:27:42.347258 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6549758e-7cb9-4fcd-8811-a39decce9d4a tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1935836625", "imageRef": "2d72b3e0-7d02-481e-b5e6-17f44e8729d6", "flavorRef": "452", "networks": [{"uuid": "93c7df90-bc10-4c6f-aaf0-7ae8fe094ccd"}]}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:27:42.404748 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.network.neutron [None req-6549758e-7cb9-4fcd-8811-a39decce9d4a tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] validate_networks() for [('93c7df90-bc10-4c6f-aaf0-7ae8fe094ccd', None, None, None, None, None)] {{(pid=117679) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 21:27:42.867778 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-6549758e-7cb9-4fcd-8811-a39decce9d4a tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Flavor limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 21:27:42.868331 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-6549758e-7cb9-4fcd-8811-a39decce9d4a tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Image limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 21:27:42.868805 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-6549758e-7cb9-4fcd-8811-a39decce9d4a tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Flavor pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 21:27:42.869212 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-6549758e-7cb9-4fcd-8811-a39decce9d4a tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Image pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 21:27:42.869618 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-6549758e-7cb9-4fcd-8811-a39decce9d4a tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 21:27:42.878615 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6549758e-7cb9-4fcd-8811-a39decce9d4a tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:42.878986 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6549758e-7cb9-4fcd-8811-a39decce9d4a tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:42.879783 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6549758e-7cb9-4fcd-8811-a39decce9d4a tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:42.880212 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6549758e-7cb9-4fcd-8811-a39decce9d4a tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:42.898026 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-6549758e-7cb9-4fcd-8811-a39decce9d4a tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Getting quotas for project 95545f74981b44aeb69f246159088da1. Resources: {'cores', 'instances', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:27:42.903336 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-6549758e-7cb9-4fcd-8811-a39decce9d4a tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Getting quotas for user 618beebad5b645c9a30632bd0677658e and project 95545f74981b44aeb69f246159088da1. Resources: {'cores', 'instances', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:27:42.915008 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-6549758e-7cb9-4fcd-8811-a39decce9d4a tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Going to run 1 instances... {{(pid=117679) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 21:27:42.917319 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-6549758e-7cb9-4fcd-8811-a39decce9d4a tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] [instance: 86074992-67cd-4849-b99e-4c8eca2e6476] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d72b3e0-7d02-481e-b5e6-17f44e8729d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 21:27:43.031048 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-6549758e-7cb9-4fcd-8811-a39decce9d4a tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.687723 May 10 21:27:43.031872 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 427/854] 10.222.0.25 () {60 vars in 1146 bytes} [Tue May 10 21:27:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 21:27:43.042283 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-19f0b795-434b-4720-a5e7-24cfec252f3a tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:43.042912 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-19f0b795-434b-4720-a5e7-24cfec252f3a tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] [instance: 86074992-67cd-4849-b99e-4c8eca2e6476] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:43.108609 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-19f0b795-434b-4720-a5e7-24cfec252f3a tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618beebad5b645c9a30632bd0677658e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95545f74981b44aeb69f246159088da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:43.120774 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-19f0b795-434b-4720-a5e7-24cfec252f3a tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] 10.222.0.25 "GET /compute/v2.1/servers/86074992-67cd-4849-b99e-4c8eca2e6476" status: 200 len: 1219 microversion: 2.1 time: 0.080140 May 10 21:27:43.120774 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 428/855] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:27:43 2022] GET /compute/v2.1/servers/86074992-67cd-4849-b99e-4c8eca2e6476 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:43.596127 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-3e9bde4a-e062-49f6-9c30-2d3e36a405ea tempest-VolumesTestJSON-715336782 tempest-VolumesTestJSON-715336782-project] Calling method '.version_select at 0x7f7aef6b2dc0>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:43.643174 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-3e9bde4a-e062-49f6-9c30-2d3e36a405ea tempest-VolumesTestJSON-715336782 tempest-VolumesTestJSON-715336782-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/8ccd17b8-b26a-4f07-a3a9-55feb1c49d06" status: 200 len: 351 microversion: 2.1 time: 0.051319 May 10 21:27:43.643782 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 428/856] 10.222.0.25 () {58 vars in 1244 bytes} [Tue May 10 21:27:43 2022] GET /compute/v2.1/os-volumes/8ccd17b8-b26a-4f07-a3a9-55feb1c49d06 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:27:44.136051 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-2fd779c9-6ce1-4940-b403-3cf9440a7626 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:44.136660 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-2fd779c9-6ce1-4940-b403-3cf9440a7626 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] [instance: 86074992-67cd-4849-b99e-4c8eca2e6476] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:44.144829 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2fd779c9-6ce1-4940-b403-3cf9440a7626 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:44.145378 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2fd779c9-6ce1-4940-b403-3cf9440a7626 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:44.146044 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2fd779c9-6ce1-4940-b403-3cf9440a7626 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:44.146507 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2fd779c9-6ce1-4940-b403-3cf9440a7626 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:44.209743 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-2fd779c9-6ce1-4940-b403-3cf9440a7626 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618beebad5b645c9a30632bd0677658e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95545f74981b44aeb69f246159088da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:44.217708 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-2fd779c9-6ce1-4940-b403-3cf9440a7626 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] 10.222.0.25 "GET /compute/v2.1/servers/86074992-67cd-4849-b99e-4c8eca2e6476" status: 200 len: 1223 microversion: 2.1 time: 0.086421 May 10 21:27:44.218525 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 429/857] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:27:44 2022] GET /compute/v2.1/servers/86074992-67cd-4849-b99e-4c8eca2e6476 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:45.223638 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-c013baca-cd46-45f6-bc3a-ea027fee1fa5 tempest-VolumesTestJSON-715336782 tempest-VolumesTestJSON-715336782-project] Calling method '.version_select at 0x7f7aef6515e0>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:45.237586 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-37364362-827f-4605-8b06-374b5d1d3644 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:45.238255 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-37364362-827f-4605-8b06-374b5d1d3644 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] [instance: 86074992-67cd-4849-b99e-4c8eca2e6476] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:45.245603 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-37364362-827f-4605-8b06-374b5d1d3644 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:45.246242 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-37364362-827f-4605-8b06-374b5d1d3644 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:45.247233 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-37364362-827f-4605-8b06-374b5d1d3644 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:45.249491 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-37364362-827f-4605-8b06-374b5d1d3644 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:45.294121 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-c013baca-cd46-45f6-bc3a-ea027fee1fa5 tempest-VolumesTestJSON-715336782 tempest-VolumesTestJSON-715336782-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e19b3389-909b-40d4-bb77-76dfa1d3d564" status: 200 len: 351 microversion: 2.1 time: 0.074831 May 10 21:27:45.294741 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 429/858] 10.222.0.25 () {58 vars in 1244 bytes} [Tue May 10 21:27:45 2022] GET /compute/v2.1/os-volumes/e19b3389-909b-40d4-bb77-76dfa1d3d564 => generated 351 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:27:45.308037 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4a454fbc-91db-49de-ae6a-e159f2a348e9 tempest-VolumesTestJSON-715336782 tempest-VolumesTestJSON-715336782-project] Calling method '.version_select at 0x7f7aea46b790>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:45.325721 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-37364362-827f-4605-8b06-374b5d1d3644 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618beebad5b645c9a30632bd0677658e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95545f74981b44aeb69f246159088da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:45.340279 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-37364362-827f-4605-8b06-374b5d1d3644 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] 10.222.0.25 "GET /compute/v2.1/servers/86074992-67cd-4849-b99e-4c8eca2e6476" status: 200 len: 1279 microversion: 2.1 time: 0.109094 May 10 21:27:45.341362 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 430/859] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:27:45 2022] GET /compute/v2.1/servers/86074992-67cd-4849-b99e-4c8eca2e6476 => generated 1279 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:27:45.408251 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4a454fbc-91db-49de-ae6a-e159f2a348e9 tempest-VolumesTestJSON-715336782 tempest-VolumesTestJSON-715336782-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.104628 May 10 21:27:45.408818 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 430/860] 10.222.0.25 () {58 vars in 1133 bytes} [Tue May 10 21:27:45 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:27:45.422019 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-cd0ec427-73ff-403b-9bf6-fe4b557c7087 tempest-VolumesTestJSON-715336782 tempest-VolumesTestJSON-715336782-project] Calling method '.version_select at 0x7f7aea2afe50>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:45.505937 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-cd0ec427-73ff-403b-9bf6-fe4b557c7087 tempest-VolumesTestJSON-715336782 tempest-VolumesTestJSON-715336782-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.087981 May 10 21:27:45.506563 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 431/861] 10.222.0.25 () {58 vars in 1148 bytes} [Tue May 10 21:27:45 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:27:45.519245 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-9572c9fe-16df-4eb5-b564-9c84ae35cb99 tempest-VolumesTestJSON-715336782 tempest-VolumesTestJSON-715336782-project] Calling method '.version_select at 0x7f7aef5bf0d0>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:45.599871 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-9572c9fe-16df-4eb5-b564-9c84ae35cb99 tempest-VolumesTestJSON-715336782 tempest-VolumesTestJSON-715336782-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.084507 May 10 21:27:45.600632 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 431/862] 10.222.0.25 () {58 vars in 1133 bytes} [Tue May 10 21:27:45 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:45.612391 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-fb42137c-5094-4462-830b-82dc90072753 tempest-VolumesTestJSON-715336782 tempest-VolumesTestJSON-715336782-project] Calling method '.version_select at 0x7f7aef6b1310>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:45.693048 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-fb42137c-5094-4462-830b-82dc90072753 tempest-VolumesTestJSON-715336782 tempest-VolumesTestJSON-715336782-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.084463 May 10 21:27:45.693614 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 432/863] 10.222.0.25 () {58 vars in 1166 bytes} [Tue May 10 21:27:45 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:27:45.705640 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-788ecdc8-9508-4b17-bd98-fbb070d3ec0c tempest-VolumesTestJSON-715336782 tempest-VolumesTestJSON-715336782-project] Calling method '.version_select at 0x7f7aea41c940>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:45.790521 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-788ecdc8-9508-4b17-bd98-fbb070d3ec0c tempest-VolumesTestJSON-715336782 tempest-VolumesTestJSON-715336782-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.088440 May 10 21:27:45.791095 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 432/864] 10.222.0.25 () {58 vars in 1169 bytes} [Tue May 10 21:27:45 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:27:45.802954 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-a55acc7d-23f7-4859-ae1a-45f1f3981d95 tempest-VolumesTestJSON-715336782 tempest-VolumesTestJSON-715336782-project] Calling method '.version_select at 0x7f7aea284c10>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:45.885738 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-a55acc7d-23f7-4859-ae1a-45f1f3981d95 tempest-VolumesTestJSON-715336782 tempest-VolumesTestJSON-715336782-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.086151 May 10 21:27:45.886300 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 433/865] 10.222.0.25 () {58 vars in 1154 bytes} [Tue May 10 21:27:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:45.897412 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6becea19-2cfb-4203-9254-0ce811ad602a tempest-VolumesTestJSON-715336782 tempest-VolumesTestJSON-715336782-project] Calling method '.version_select at 0x7f7aef614160>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:45.976109 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-6becea19-2cfb-4203-9254-0ce811ad602a tempest-VolumesTestJSON-715336782 tempest-VolumesTestJSON-715336782-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.082529 May 10 21:27:45.977467 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 433/866] 10.222.0.25 () {58 vars in 1187 bytes} [Tue May 10 21:27:45 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:27:45.988770 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-6d1e0e79-3ce0-4055-9d4c-2abe446feed7 tempest-VolumesTestJSON-715336782 tempest-VolumesTestJSON-715336782-project] Calling method '.version_select at 0x7f7aea284040>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:46.071520 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-6d1e0e79-3ce0-4055-9d4c-2abe446feed7 tempest-VolumesTestJSON-715336782 tempest-VolumesTestJSON-715336782-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.086449 May 10 21:27:46.072091 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 434/867] 10.222.0.25 () {58 vars in 1154 bytes} [Tue May 10 21:27:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:46.358011 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-b8958664-384d-41cf-baae-1ae122a6fc1c tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:46.358667 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-b8958664-384d-41cf-baae-1ae122a6fc1c tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] [instance: 86074992-67cd-4849-b99e-4c8eca2e6476] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:46.364646 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b8958664-384d-41cf-baae-1ae122a6fc1c tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:46.365097 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b8958664-384d-41cf-baae-1ae122a6fc1c tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:46.365869 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b8958664-384d-41cf-baae-1ae122a6fc1c tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:46.366309 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b8958664-384d-41cf-baae-1ae122a6fc1c tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:46.521963 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b8958664-384d-41cf-baae-1ae122a6fc1c tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618beebad5b645c9a30632bd0677658e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95545f74981b44aeb69f246159088da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:46.530115 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-b8958664-384d-41cf-baae-1ae122a6fc1c tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] 10.222.0.25 "GET /compute/v2.1/servers/86074992-67cd-4849-b99e-4c8eca2e6476" status: 200 len: 1319 microversion: 2.1 time: 0.176386 May 10 21:27:46.530723 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 434/868] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:27:46 2022] GET /compute/v2.1/servers/86074992-67cd-4849-b99e-4c8eca2e6476 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:46.887403 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-0c75fec7-1fab-47c5-8b47-c3ca5fe2e5f8 req-d0b60d7b-e520-4c1b-8982-7f82a479b2de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86074992-67cd-4849-b99e-4c8eca2e6476", "tag": "f61c3a10-f88e-46d9-a103-e985e2676aac"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:27:46.897308 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-0c75fec7-1fab-47c5-8b47-c3ca5fe2e5f8 req-d0b60d7b-e520-4c1b-8982-7f82a479b2de service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:46.897848 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-0c75fec7-1fab-47c5-8b47-c3ca5fe2e5f8 req-d0b60d7b-e520-4c1b-8982-7f82a479b2de service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:46.910764 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-0c75fec7-1fab-47c5-8b47-c3ca5fe2e5f8 req-d0b60d7b-e520-4c1b-8982-7f82a479b2de service nova] Creating event network-changed:f61c3a10-f88e-46d9-a103-e985e2676aac for instance 86074992-67cd-4849-b99e-4c8eca2e6476 on hv-cinder-83608 May 10 21:27:46.917568 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-0c75fec7-1fab-47c5-8b47-c3ca5fe2e5f8 req-d0b60d7b-e520-4c1b-8982-7f82a479b2de service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035211 May 10 21:27:46.918392 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 435/869] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:27:47.547387 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-d22203d6-46e6-4657-b09b-8fbdc4e8826e tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:47.548107 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-d22203d6-46e6-4657-b09b-8fbdc4e8826e tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] [instance: 86074992-67cd-4849-b99e-4c8eca2e6476] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:47.555220 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d22203d6-46e6-4657-b09b-8fbdc4e8826e tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:47.555672 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d22203d6-46e6-4657-b09b-8fbdc4e8826e tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:47.556444 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d22203d6-46e6-4657-b09b-8fbdc4e8826e tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:47.556878 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d22203d6-46e6-4657-b09b-8fbdc4e8826e tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:47.701615 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-d22203d6-46e6-4657-b09b-8fbdc4e8826e tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618beebad5b645c9a30632bd0677658e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95545f74981b44aeb69f246159088da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:47.709251 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-d22203d6-46e6-4657-b09b-8fbdc4e8826e tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] 10.222.0.25 "GET /compute/v2.1/servers/86074992-67cd-4849-b99e-4c8eca2e6476" status: 200 len: 1319 microversion: 2.1 time: 0.165772 May 10 21:27:47.709822 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 435/870] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:27:47 2022] GET /compute/v2.1/servers/86074992-67cd-4849-b99e-4c8eca2e6476 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:48.729290 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-406eef9c-3119-4f6b-a20c-0184e4a8f24c tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:48.730326 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-406eef9c-3119-4f6b-a20c-0184e4a8f24c tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] [instance: 86074992-67cd-4849-b99e-4c8eca2e6476] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:48.736977 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-406eef9c-3119-4f6b-a20c-0184e4a8f24c tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:48.737417 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-406eef9c-3119-4f6b-a20c-0184e4a8f24c tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:48.738183 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-406eef9c-3119-4f6b-a20c-0184e4a8f24c tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:48.738642 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-406eef9c-3119-4f6b-a20c-0184e4a8f24c tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:48.886149 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-406eef9c-3119-4f6b-a20c-0184e4a8f24c tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618beebad5b645c9a30632bd0677658e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95545f74981b44aeb69f246159088da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:48.893340 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-406eef9c-3119-4f6b-a20c-0184e4a8f24c tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] 10.222.0.25 "GET /compute/v2.1/servers/86074992-67cd-4849-b99e-4c8eca2e6476" status: 200 len: 1319 microversion: 2.1 time: 0.170386 May 10 21:27:48.893905 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 436/871] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:27:48 2022] GET /compute/v2.1/servers/86074992-67cd-4849-b99e-4c8eca2e6476 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:49.911138 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-b1e2593c-055b-4ee2-a0fc-1b7bc74fdaed tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:49.912342 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-b1e2593c-055b-4ee2-a0fc-1b7bc74fdaed tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] [instance: 86074992-67cd-4849-b99e-4c8eca2e6476] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:49.921212 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b1e2593c-055b-4ee2-a0fc-1b7bc74fdaed tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:49.921655 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b1e2593c-055b-4ee2-a0fc-1b7bc74fdaed tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:49.922425 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b1e2593c-055b-4ee2-a0fc-1b7bc74fdaed tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:49.922882 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b1e2593c-055b-4ee2-a0fc-1b7bc74fdaed tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:50.065127 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b1e2593c-055b-4ee2-a0fc-1b7bc74fdaed tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618beebad5b645c9a30632bd0677658e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95545f74981b44aeb69f246159088da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:50.072594 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-b1e2593c-055b-4ee2-a0fc-1b7bc74fdaed tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] 10.222.0.25 "GET /compute/v2.1/servers/86074992-67cd-4849-b99e-4c8eca2e6476" status: 200 len: 1319 microversion: 2.1 time: 0.165632 May 10 21:27:50.073165 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 436/872] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:27:49 2022] GET /compute/v2.1/servers/86074992-67cd-4849-b99e-4c8eca2e6476 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:51.089524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-3d948de7-19ed-4ce7-b5ac-50cb7a239198 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:51.090117 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-3d948de7-19ed-4ce7-b5ac-50cb7a239198 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] [instance: 86074992-67cd-4849-b99e-4c8eca2e6476] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:51.096554 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3d948de7-19ed-4ce7-b5ac-50cb7a239198 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:51.100800 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3d948de7-19ed-4ce7-b5ac-50cb7a239198 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:51.100800 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3d948de7-19ed-4ce7-b5ac-50cb7a239198 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:51.100800 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3d948de7-19ed-4ce7-b5ac-50cb7a239198 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:51.231180 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-3d948de7-19ed-4ce7-b5ac-50cb7a239198 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618beebad5b645c9a30632bd0677658e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95545f74981b44aeb69f246159088da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:51.237520 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-3d948de7-19ed-4ce7-b5ac-50cb7a239198 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] 10.222.0.25 "GET /compute/v2.1/servers/86074992-67cd-4849-b99e-4c8eca2e6476" status: 200 len: 1319 microversion: 2.1 time: 0.152364 May 10 21:27:51.238096 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 437/873] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:27:51 2022] GET /compute/v2.1/servers/86074992-67cd-4849-b99e-4c8eca2e6476 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:52.102220 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-e1510435-99d1-46d6-b6bc-bfd5430d391b req-b7adc814-ef71-455d-a295-4f9a7114af08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86074992-67cd-4849-b99e-4c8eca2e6476", "name": "network-vif-plugged", "status": "completed", "tag": "f61c3a10-f88e-46d9-a103-e985e2676aac"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:27:52.113095 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-e1510435-99d1-46d6-b6bc-bfd5430d391b req-b7adc814-ef71-455d-a295-4f9a7114af08 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:52.113535 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-e1510435-99d1-46d6-b6bc-bfd5430d391b req-b7adc814-ef71-455d-a295-4f9a7114af08 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:52.126093 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-e1510435-99d1-46d6-b6bc-bfd5430d391b req-b7adc814-ef71-455d-a295-4f9a7114af08 service nova] Creating event network-vif-plugged:f61c3a10-f88e-46d9-a103-e985e2676aac for instance 86074992-67cd-4849-b99e-4c8eca2e6476 on hv-cinder-83608 May 10 21:27:52.131489 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-e1510435-99d1-46d6-b6bc-bfd5430d391b req-b7adc814-ef71-455d-a295-4f9a7114af08 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035339 May 10 21:27:52.132455 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 437/874] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:27:52.255099 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-0620eaa4-5b21-47ac-9760-9333a03c9aad tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:52.255707 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-0620eaa4-5b21-47ac-9760-9333a03c9aad tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] [instance: 86074992-67cd-4849-b99e-4c8eca2e6476] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:52.263470 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0620eaa4-5b21-47ac-9760-9333a03c9aad tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:52.263915 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0620eaa4-5b21-47ac-9760-9333a03c9aad tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:52.264686 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0620eaa4-5b21-47ac-9760-9333a03c9aad tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:52.265117 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0620eaa4-5b21-47ac-9760-9333a03c9aad tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:52.407238 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-0620eaa4-5b21-47ac-9760-9333a03c9aad tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618beebad5b645c9a30632bd0677658e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95545f74981b44aeb69f246159088da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:52.417228 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-0620eaa4-5b21-47ac-9760-9333a03c9aad tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] 10.222.0.25 "GET /compute/v2.1/servers/86074992-67cd-4849-b99e-4c8eca2e6476" status: 200 len: 1319 microversion: 2.1 time: 0.165891 May 10 21:27:52.417832 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 438/875] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:27:52 2022] GET /compute/v2.1/servers/86074992-67cd-4849-b99e-4c8eca2e6476 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:53.435461 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-d08a4d41-93f8-4302-809d-ad7df2fda3ed tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:53.436214 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-d08a4d41-93f8-4302-809d-ad7df2fda3ed tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] [instance: 86074992-67cd-4849-b99e-4c8eca2e6476] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:53.442839 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d08a4d41-93f8-4302-809d-ad7df2fda3ed tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:53.443285 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d08a4d41-93f8-4302-809d-ad7df2fda3ed tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:53.444182 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d08a4d41-93f8-4302-809d-ad7df2fda3ed tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:53.444618 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d08a4d41-93f8-4302-809d-ad7df2fda3ed tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:53.577571 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-d08a4d41-93f8-4302-809d-ad7df2fda3ed tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618beebad5b645c9a30632bd0677658e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95545f74981b44aeb69f246159088da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:53.584823 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-d08a4d41-93f8-4302-809d-ad7df2fda3ed tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] 10.222.0.25 "GET /compute/v2.1/servers/86074992-67cd-4849-b99e-4c8eca2e6476" status: 200 len: 1319 microversion: 2.1 time: 0.154208 May 10 21:27:53.585392 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 438/876] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:27:53 2022] GET /compute/v2.1/servers/86074992-67cd-4849-b99e-4c8eca2e6476 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:54.601118 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-93c9d5a0-4f3e-4794-a8a3-80cf89a37a40 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:54.601725 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-93c9d5a0-4f3e-4794-a8a3-80cf89a37a40 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] [instance: 86074992-67cd-4849-b99e-4c8eca2e6476] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:54.608940 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-93c9d5a0-4f3e-4794-a8a3-80cf89a37a40 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:54.609409 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-93c9d5a0-4f3e-4794-a8a3-80cf89a37a40 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:54.610179 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-93c9d5a0-4f3e-4794-a8a3-80cf89a37a40 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:54.610655 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-93c9d5a0-4f3e-4794-a8a3-80cf89a37a40 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:54.741382 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-93c9d5a0-4f3e-4794-a8a3-80cf89a37a40 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618beebad5b645c9a30632bd0677658e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95545f74981b44aeb69f246159088da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:54.749490 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-93c9d5a0-4f3e-4794-a8a3-80cf89a37a40 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] 10.222.0.25 "GET /compute/v2.1/servers/86074992-67cd-4849-b99e-4c8eca2e6476" status: 200 len: 1507 microversion: 2.1 time: 0.152183 May 10 21:27:54.750074 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 439/877] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:27:54 2022] GET /compute/v2.1/servers/86074992-67cd-4849-b99e-4c8eca2e6476 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:13.694577 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-942a1bf5-09cb-4ff3-a87c-6008fea99502 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d50e8082-3b5a-440a-bdcf-f36680336b3a", "device": "/dev/sdb"}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:28:13.696104 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-942a1bf5-09cb-4ff3-a87c-6008fea99502 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] [instance: 86074992-67cd-4849-b99e-4c8eca2e6476] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:13.703244 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-942a1bf5-09cb-4ff3-a87c-6008fea99502 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:13.703690 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-942a1bf5-09cb-4ff3-a87c-6008fea99502 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:13.704460 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-942a1bf5-09cb-4ff3-a87c-6008fea99502 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:13.704893 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-942a1bf5-09cb-4ff3-a87c-6008fea99502 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:14.465792 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-942a1bf5-09cb-4ff3-a87c-6008fea99502 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] 10.222.0.25 "POST /compute/v2.1/servers/86074992-67cd-4849-b99e-4c8eca2e6476/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.775480 May 10 21:28:14.466673 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 439/878] 10.222.0.25 () {60 vars in 1322 bytes} [Tue May 10 21:28:13 2022] POST /compute/v2.1/servers/86074992-67cd-4849-b99e-4c8eca2e6476/os-volume_attachments => generated 194 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:28:39.024874 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-4623c6a3-ff1f-42af-bcbb-3c9b974f6b76 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:39.025364 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-4623c6a3-ff1f-42af-bcbb-3c9b974f6b76 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] [instance: 86074992-67cd-4849-b99e-4c8eca2e6476] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:39.031781 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4623c6a3-ff1f-42af-bcbb-3c9b974f6b76 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:39.032321 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4623c6a3-ff1f-42af-bcbb-3c9b974f6b76 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:39.032972 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4623c6a3-ff1f-42af-bcbb-3c9b974f6b76 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:39.033402 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-4623c6a3-ff1f-42af-bcbb-3c9b974f6b76 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:39.113123 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.objects.instance [None req-4623c6a3-ff1f-42af-bcbb-3c9b974f6b76 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lazy-loading 'services' on Instance uuid 86074992-67cd-4849-b99e-4c8eca2e6476 {{(pid=117678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:28:39.364953 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-4623c6a3-ff1f-42af-bcbb-3c9b974f6b76 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] 10.222.0.25 "DELETE /compute/v2.1/servers/86074992-67cd-4849-b99e-4c8eca2e6476/os-volume_attachments/d50e8082-3b5a-440a-bdcf-f36680336b3a" status: 202 len: 0 microversion: 2.1 time: 0.343798 May 10 21:28:39.365551 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 440/879] 10.222.0.25 () {58 vars in 1415 bytes} [Tue May 10 21:28:39 2022] DELETE /compute/v2.1/servers/86074992-67cd-4849-b99e-4c8eca2e6476/os-volume_attachments/d50e8082-3b5a-440a-bdcf-f36680336b3a => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 21:28:40.486027 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-c19af5c6-3145-4baf-833d-295a0730b52d tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:40.486723 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-c19af5c6-3145-4baf-833d-295a0730b52d tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] [instance: 86074992-67cd-4849-b99e-4c8eca2e6476] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:40.492837 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c19af5c6-3145-4baf-833d-295a0730b52d tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:40.493389 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c19af5c6-3145-4baf-833d-295a0730b52d tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:40.494223 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c19af5c6-3145-4baf-833d-295a0730b52d tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:40.494685 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c19af5c6-3145-4baf-833d-295a0730b52d tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:40.521254 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-c19af5c6-3145-4baf-833d-295a0730b52d tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] [instance: 86074992-67cd-4849-b99e-4c8eca2e6476] Going to try to terminate instance {{(pid=117679) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 21:28:40.937489 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-c19af5c6-3145-4baf-833d-295a0730b52d tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] 10.222.0.25 "DELETE /compute/v2.1/servers/86074992-67cd-4849-b99e-4c8eca2e6476" status: 204 len: 0 microversion: 2.1 time: 0.455623 May 10 21:28:40.938083 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 440/880] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 10 21:28:40 2022] DELETE /compute/v2.1/servers/86074992-67cd-4849-b99e-4c8eca2e6476 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 21:28:40.947208 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-529e6708-716c-491a-b832-ab910f5a458c tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:40.947991 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-529e6708-716c-491a-b832-ab910f5a458c tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] [instance: 86074992-67cd-4849-b99e-4c8eca2e6476] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:40.954592 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-529e6708-716c-491a-b832-ab910f5a458c tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:40.955031 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-529e6708-716c-491a-b832-ab910f5a458c tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:40.955863 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-529e6708-716c-491a-b832-ab910f5a458c tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:40.956322 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-529e6708-716c-491a-b832-ab910f5a458c tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:41.085495 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-529e6708-716c-491a-b832-ab910f5a458c tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618beebad5b645c9a30632bd0677658e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95545f74981b44aeb69f246159088da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:41.093517 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-529e6708-716c-491a-b832-ab910f5a458c tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] 10.222.0.25 "GET /compute/v2.1/servers/86074992-67cd-4849-b99e-4c8eca2e6476" status: 200 len: 1513 microversion: 2.1 time: 0.151011 May 10 21:28:41.094086 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 441/881] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:28:40 2022] GET /compute/v2.1/servers/86074992-67cd-4849-b99e-4c8eca2e6476 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:42.111222 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-826e3da2-d917-4c7e-b6ab-c15b69430e64 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:42.111918 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-826e3da2-d917-4c7e-b6ab-c15b69430e64 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] [instance: 86074992-67cd-4849-b99e-4c8eca2e6476] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:42.118537 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-826e3da2-d917-4c7e-b6ab-c15b69430e64 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:42.118985 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-826e3da2-d917-4c7e-b6ab-c15b69430e64 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:42.119763 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-826e3da2-d917-4c7e-b6ab-c15b69430e64 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:42.120175 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-826e3da2-d917-4c7e-b6ab-c15b69430e64 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:42.254363 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-826e3da2-d917-4c7e-b6ab-c15b69430e64 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618beebad5b645c9a30632bd0677658e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95545f74981b44aeb69f246159088da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:42.261502 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-826e3da2-d917-4c7e-b6ab-c15b69430e64 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] 10.222.0.25 "GET /compute/v2.1/servers/86074992-67cd-4849-b99e-4c8eca2e6476" status: 200 len: 1513 microversion: 2.1 time: 0.154927 May 10 21:28:42.269864 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 441/882] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:28:42 2022] GET /compute/v2.1/servers/86074992-67cd-4849-b99e-4c8eca2e6476 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:42.979341 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-e3c12939-3fb4-4277-83c4-95530320647f req-9000cf12-e037-48c8-b75d-73d7f961da69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86074992-67cd-4849-b99e-4c8eca2e6476", "name": "network-vif-deleted", "tag": "f61c3a10-f88e-46d9-a103-e985e2676aac"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:28:42.987894 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-e3c12939-3fb4-4277-83c4-95530320647f req-9000cf12-e037-48c8-b75d-73d7f961da69 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:42.988330 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-e3c12939-3fb4-4277-83c4-95530320647f req-9000cf12-e037-48c8-b75d-73d7f961da69 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:42.999697 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-e3c12939-3fb4-4277-83c4-95530320647f req-9000cf12-e037-48c8-b75d-73d7f961da69 service nova] Creating event network-vif-deleted:f61c3a10-f88e-46d9-a103-e985e2676aac for instance 86074992-67cd-4849-b99e-4c8eca2e6476 on hv-cinder-83608 May 10 21:28:43.004509 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-e3c12939-3fb4-4277-83c4-95530320647f req-9000cf12-e037-48c8-b75d-73d7f961da69 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028823 May 10 21:28:43.008681 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 442/883] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:28:43.278615 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-2d4eb789-3a89-471f-9150-92c535eb7fc3 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:43.279365 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-2d4eb789-3a89-471f-9150-92c535eb7fc3 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] [instance: 86074992-67cd-4849-b99e-4c8eca2e6476] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:43.285707 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2d4eb789-3a89-471f-9150-92c535eb7fc3 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:43.286147 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2d4eb789-3a89-471f-9150-92c535eb7fc3 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:43.286942 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2d4eb789-3a89-471f-9150-92c535eb7fc3 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:43.287367 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2d4eb789-3a89-471f-9150-92c535eb7fc3 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:43.353941 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2d4eb789-3a89-471f-9150-92c535eb7fc3 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618beebad5b645c9a30632bd0677658e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95545f74981b44aeb69f246159088da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:43.361762 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-2d4eb789-3a89-471f-9150-92c535eb7fc3 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] 10.222.0.25 "GET /compute/v2.1/servers/86074992-67cd-4849-b99e-4c8eca2e6476" status: 200 len: 1304 microversion: 2.1 time: 0.087093 May 10 21:28:43.362335 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 442/884] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:28:43 2022] GET /compute/v2.1/servers/86074992-67cd-4849-b99e-4c8eca2e6476 => generated 1304 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:44.380995 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-e877b434-a36a-45d6-98b4-ff9c4c3211cc tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:44.381696 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-e877b434-a36a-45d6-98b4-ff9c4c3211cc tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] [instance: 86074992-67cd-4849-b99e-4c8eca2e6476] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:44.388486 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e877b434-a36a-45d6-98b4-ff9c4c3211cc tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:44.389642 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e877b434-a36a-45d6-98b4-ff9c4c3211cc tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:44.390635 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e877b434-a36a-45d6-98b4-ff9c4c3211cc tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:44.391083 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e877b434-a36a-45d6-98b4-ff9c4c3211cc tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:44.407296 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.wsgi [None req-e877b434-a36a-45d6-98b4-ff9c4c3211cc tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] HTTP exception thrown: Instance 86074992-67cd-4849-b99e-4c8eca2e6476 could not be found. May 10 21:28:44.408998 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-e877b434-a36a-45d6-98b4-ff9c4c3211cc tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Request method failure captured: May 10 21:28:44.408998 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: request: GET /compute/v2.1/servers/86074992-67cd-4849-b99e-4c8eca2e6476 HTTP/1.1 May 10 21:28:44.408998 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept: application/json May 10 21:28:44.408998 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept-Encoding: identity May 10 21:28:44.408998 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Connection: close May 10 21:28:44.408998 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Length: 0 May 10 21:28:44.408998 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Type: application/json May 10 21:28:44.408998 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Host: 10.222.0.25 May 10 21:28:44.408998 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Openstack-System-Scope: None May 10 21:28:44.408998 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: User-Agent: python-urllib3/1.26.9 May 10 21:28:44.408998 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Auth-Token: gAAAAABietjMGLGvU0LzR9KjXfzPkEXCboMk1QcB0bCNZCt4NxzezZh2iUmpidYzU8xJ5G86wN87eVrhs9lHiEa1p9KlpPZl6-J0_iYQV8A8f0rm4LLH-0fjGLTIqacUN1yaKvamfGUY3dy3amwdqTJ3odG19Pso75eyGI1se7vtSozQXH3duuE May 10 21:28:44.408998 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Id: None May 10 21:28:44.408998 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Name: None May 10 21:28:44.408998 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Identity-Status: Confirmed May 10 21:28:44.408998 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Is-Admin-Project: True May 10 21:28:44.408998 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Id: default May 10 21:28:44.408998 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Name: Default May 10 21:28:44.408998 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Id: 95545f74981b44aeb69f246159088da1 May 10 21:28:44.408998 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1370820569 May 10 21:28:44.408998 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Role: member,reader May 10 21:28:44.408998 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Roles: member,reader May 10 21:28:44.412923 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/95545f74981b44aeb69f246159088da1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_95545f74981b44aeb69f246159088da1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/95545f74981b44aeb69f246159088da1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/95545f74981b44aeb69f246159088da1"}]}] May 10 21:28:44.412923 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant: tempest-VolumesSnapshotTestJSON-1370820569 May 10 21:28:44.412923 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Id: 95545f74981b44aeb69f246159088da1 May 10 21:28:44.412923 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1370820569 May 10 21:28:44.412923 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User: tempest-VolumesSnapshotTestJSON-1370820569-project May 10 21:28:44.412923 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Id: default May 10 21:28:44.412923 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Name: Default May 10 21:28:44.412923 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Id: 618beebad5b645c9a30632bd0677658e May 10 21:28:44.412923 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Name: tempest-VolumesSnapshotTestJSON-1370820569-project May 10 21:28:44.412923 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: method: > May 10 21:28:44.412923 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: exception: Instance 86074992-67cd-4849-b99e-4c8eca2e6476 could not be found. May 10 21:28:44.412923 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: action_args: {'id': '86074992-67cd-4849-b99e-4c8eca2e6476'} May 10 21:28:44.413999 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:28:44.413999 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:28:44.413999 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:28:44.413999 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:28:44.413999 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:28:44.413999 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:28:44.413999 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:28:44.413999 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:28:44.413999 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:28:44.413999 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:28:44.413999 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86074992-67cd-4849-b99e-4c8eca2e6476 could not be found. May 10 21:28:44.413999 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:28:44.413999 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:28:44.413999 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:28:44.413999 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:28:44.413999 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:28:44.413999 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:28:44.413999 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:28:44.413999 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:28:44.413999 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:28:44.415585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:28:44.415585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:28:44.415585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:28:44.415585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:28:44.415585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:28:44.415585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:28:44.415585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:28:44.415585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86074992-67cd-4849-b99e-4c8eca2e6476 could not be found. May 10 21:28:44.415585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:28:44.415585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:28:44.415585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:28:44.415585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:28:44.415585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:28:44.415585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:28:44.415585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:28:44.415585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:28:44.415585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86074992-67cd-4849-b99e-4c8eca2e6476 could not be found. May 10 21:28:44.415585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:28:44.416860 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-e877b434-a36a-45d6-98b4-ff9c4c3211cc tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Returning 404 to user: Instance 86074992-67cd-4849-b99e-4c8eca2e6476 could not be found. {{(pid=117678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:28:44.416860 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-e877b434-a36a-45d6-98b4-ff9c4c3211cc tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] 10.222.0.25 "GET /compute/v2.1/servers/86074992-67cd-4849-b99e-4c8eca2e6476" status: 404 len: 111 microversion: 2.1 time: 0.034339 May 10 21:28:44.416860 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 443/885] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:28:44 2022] GET /compute/v2.1/servers/86074992-67cd-4849-b99e-4c8eca2e6476 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:28:49.652289 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-008e7a9c-9ff7-4e86-88b2-c90d7421f886 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2078519794", "imageRef": "2d72b3e0-7d02-481e-b5e6-17f44e8729d6", "flavorRef": "452", "networks": [{"uuid": "7bf18228-0ae0-4bdb-9da9-418eb8cadc32"}]}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:28:49.702888 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.network.neutron [None req-008e7a9c-9ff7-4e86-88b2-c90d7421f886 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] validate_networks() for [('7bf18228-0ae0-4bdb-9da9-418eb8cadc32', None, None, None, None, None)] {{(pid=117679) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 21:28:50.044493 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-008e7a9c-9ff7-4e86-88b2-c90d7421f886 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Flavor limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 21:28:50.045569 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-008e7a9c-9ff7-4e86-88b2-c90d7421f886 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Image limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 21:28:50.046035 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-008e7a9c-9ff7-4e86-88b2-c90d7421f886 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Flavor pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 21:28:50.046457 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-008e7a9c-9ff7-4e86-88b2-c90d7421f886 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Image pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 21:28:50.046859 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-008e7a9c-9ff7-4e86-88b2-c90d7421f886 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 21:28:50.055306 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-008e7a9c-9ff7-4e86-88b2-c90d7421f886 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:50.055745 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-008e7a9c-9ff7-4e86-88b2-c90d7421f886 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:50.056528 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-008e7a9c-9ff7-4e86-88b2-c90d7421f886 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:50.056951 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-008e7a9c-9ff7-4e86-88b2-c90d7421f886 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:50.072954 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-008e7a9c-9ff7-4e86-88b2-c90d7421f886 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Getting quotas for project ea060bca7aa9440ba37d2093af6e9d16. Resources: {'cores', 'instances', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:28:50.076934 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-008e7a9c-9ff7-4e86-88b2-c90d7421f886 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Getting quotas for user ca75f3a5742c42e6a1ddeb117df6f01e and project ea060bca7aa9440ba37d2093af6e9d16. Resources: {'cores', 'instances', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:28:50.087400 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-008e7a9c-9ff7-4e86-88b2-c90d7421f886 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Going to run 1 instances... {{(pid=117679) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 21:28:50.089584 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-008e7a9c-9ff7-4e86-88b2-c90d7421f886 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: 874458f4-97d1-4e82-99fc-1af038d31220] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d72b3e0-7d02-481e-b5e6-17f44e8729d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 21:28:50.200520 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-008e7a9c-9ff7-4e86-88b2-c90d7421f886 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.552165 May 10 21:28:50.201313 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 443/886] 10.222.0.25 () {60 vars in 1146 bytes} [Tue May 10 21:28:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 21:28:50.211185 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-a8ae1f9a-ec53-4d9d-954d-a3863b820d56 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:50.211887 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-a8ae1f9a-ec53-4d9d-954d-a3863b820d56 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: 874458f4-97d1-4e82-99fc-1af038d31220] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:50.266697 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-a8ae1f9a-ec53-4d9d-954d-a3863b820d56 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f3a5742c42e6a1ddeb117df6f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea060bca7aa9440ba37d2093af6e9d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:50.273327 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-a8ae1f9a-ec53-4d9d-954d-a3863b820d56 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220" status: 200 len: 1214 microversion: 2.1 time: 0.065857 May 10 21:28:50.273887 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 444/887] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:28:50 2022] GET /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220 => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:51.291829 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-3ec85284-a40b-480b-8398-9e00a66e734b tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:51.291829 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-3ec85284-a40b-480b-8398-9e00a66e734b tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: 874458f4-97d1-4e82-99fc-1af038d31220] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:51.343249 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-3ec85284-a40b-480b-8398-9e00a66e734b tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f3a5742c42e6a1ddeb117df6f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea060bca7aa9440ba37d2093af6e9d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:51.349984 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-3ec85284-a40b-480b-8398-9e00a66e734b tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220" status: 200 len: 1214 microversion: 2.1 time: 0.064571 May 10 21:28:51.350590 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 444/888] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:28:51 2022] GET /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220 => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:52.366276 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-17dfeaa6-3b9a-4492-87bb-fd72a09ab6dc tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:52.366907 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-17dfeaa6-3b9a-4492-87bb-fd72a09ab6dc tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: 874458f4-97d1-4e82-99fc-1af038d31220] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:52.420515 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-17dfeaa6-3b9a-4492-87bb-fd72a09ab6dc tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f3a5742c42e6a1ddeb117df6f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea060bca7aa9440ba37d2093af6e9d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:52.427403 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-17dfeaa6-3b9a-4492-87bb-fd72a09ab6dc tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220" status: 200 len: 1214 microversion: 2.1 time: 0.064874 May 10 21:28:52.427964 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 445/889] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:28:52 2022] GET /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220 => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:52.736474 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-473a734a-6514-485c-b146-0d78aeefcdc8 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1328250191", "imageRef": "2d72b3e0-7d02-481e-b5e6-17f44e8729d6", "flavorRef": "452", "networks": [{"uuid": "93c7df90-bc10-4c6f-aaf0-7ae8fe094ccd"}]}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:28:52.787628 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.network.neutron [None req-473a734a-6514-485c-b146-0d78aeefcdc8 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] validate_networks() for [('93c7df90-bc10-4c6f-aaf0-7ae8fe094ccd', None, None, None, None, None)] {{(pid=117679) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 21:28:53.369587 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-473a734a-6514-485c-b146-0d78aeefcdc8 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Flavor limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 21:28:53.370004 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-473a734a-6514-485c-b146-0d78aeefcdc8 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Image limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 21:28:53.370485 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-473a734a-6514-485c-b146-0d78aeefcdc8 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Flavor pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 21:28:53.377110 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-473a734a-6514-485c-b146-0d78aeefcdc8 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Image pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 21:28:53.377110 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-473a734a-6514-485c-b146-0d78aeefcdc8 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 21:28:53.379797 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-473a734a-6514-485c-b146-0d78aeefcdc8 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:53.380285 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-473a734a-6514-485c-b146-0d78aeefcdc8 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:53.381076 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-473a734a-6514-485c-b146-0d78aeefcdc8 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:53.381504 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-473a734a-6514-485c-b146-0d78aeefcdc8 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:53.398773 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-473a734a-6514-485c-b146-0d78aeefcdc8 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Getting quotas for project 95545f74981b44aeb69f246159088da1. Resources: {'cores', 'instances', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:28:53.402312 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-473a734a-6514-485c-b146-0d78aeefcdc8 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Getting quotas for user 618beebad5b645c9a30632bd0677658e and project 95545f74981b44aeb69f246159088da1. Resources: {'cores', 'instances', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:28:53.413979 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-473a734a-6514-485c-b146-0d78aeefcdc8 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Going to run 1 instances... {{(pid=117679) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 21:28:53.416259 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-473a734a-6514-485c-b146-0d78aeefcdc8 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] [instance: 0664bc19-9eb0-4a77-82e1-9a359cae128d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d72b3e0-7d02-481e-b5e6-17f44e8729d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 21:28:53.443868 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-64d5f3c2-0840-4941-adec-69f7861fad12 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:53.444525 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-64d5f3c2-0840-4941-adec-69f7861fad12 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: 874458f4-97d1-4e82-99fc-1af038d31220] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:53.505080 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-64d5f3c2-0840-4941-adec-69f7861fad12 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f3a5742c42e6a1ddeb117df6f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea060bca7aa9440ba37d2093af6e9d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:53.512110 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-64d5f3c2-0840-4941-adec-69f7861fad12 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220" status: 200 len: 1214 microversion: 2.1 time: 0.072188 May 10 21:28:53.512673 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 446/890] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:28:53 2022] GET /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:28:53.524576 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-473a734a-6514-485c-b146-0d78aeefcdc8 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.792081 May 10 21:28:53.525379 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 445/891] 10.222.0.25 () {60 vars in 1146 bytes} [Tue May 10 21:28:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 21:28:53.535962 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-a784d78f-d887-4d15-bd46-fe727e959b1f tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:53.536566 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-a784d78f-d887-4d15-bd46-fe727e959b1f tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] [instance: 0664bc19-9eb0-4a77-82e1-9a359cae128d] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:53.588764 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-a784d78f-d887-4d15-bd46-fe727e959b1f tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618beebad5b645c9a30632bd0677658e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95545f74981b44aeb69f246159088da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:53.596536 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-a784d78f-d887-4d15-bd46-fe727e959b1f tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] 10.222.0.25 "GET /compute/v2.1/servers/0664bc19-9eb0-4a77-82e1-9a359cae128d" status: 200 len: 1219 microversion: 2.1 time: 0.064426 May 10 21:28:53.597098 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 447/892] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:28:53 2022] GET /compute/v2.1/servers/0664bc19-9eb0-4a77-82e1-9a359cae128d => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:28:54.529984 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-ad00e506-e649-474b-a52f-d03f56519a25 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:54.530625 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-ad00e506-e649-474b-a52f-d03f56519a25 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: 874458f4-97d1-4e82-99fc-1af038d31220] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:54.537410 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ad00e506-e649-474b-a52f-d03f56519a25 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:54.538397 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ad00e506-e649-474b-a52f-d03f56519a25 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:54.538671 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ad00e506-e649-474b-a52f-d03f56519a25 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:54.539102 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ad00e506-e649-474b-a52f-d03f56519a25 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:54.601359 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-ad00e506-e649-474b-a52f-d03f56519a25 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f3a5742c42e6a1ddeb117df6f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea060bca7aa9440ba37d2093af6e9d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:54.608754 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-ad00e506-e649-474b-a52f-d03f56519a25 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220" status: 200 len: 1218 microversion: 2.1 time: 0.083264 May 10 21:28:54.609324 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 446/893] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:28:54 2022] GET /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:54.613860 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-acf0609a-5fb4-4a1f-afef-458ccf3c80ba tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:54.614498 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-acf0609a-5fb4-4a1f-afef-458ccf3c80ba tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] [instance: 0664bc19-9eb0-4a77-82e1-9a359cae128d] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:54.620912 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-acf0609a-5fb4-4a1f-afef-458ccf3c80ba tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:54.621360 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-acf0609a-5fb4-4a1f-afef-458ccf3c80ba tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:54.622121 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-acf0609a-5fb4-4a1f-afef-458ccf3c80ba tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:54.622579 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-acf0609a-5fb4-4a1f-afef-458ccf3c80ba tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:54.684182 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-acf0609a-5fb4-4a1f-afef-458ccf3c80ba tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618beebad5b645c9a30632bd0677658e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95545f74981b44aeb69f246159088da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:54.693100 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-acf0609a-5fb4-4a1f-afef-458ccf3c80ba tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] 10.222.0.25 "GET /compute/v2.1/servers/0664bc19-9eb0-4a77-82e1-9a359cae128d" status: 200 len: 1223 microversion: 2.1 time: 0.082921 May 10 21:28:54.693667 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 448/894] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:28:54 2022] GET /compute/v2.1/servers/0664bc19-9eb0-4a77-82e1-9a359cae128d => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:28:55.626603 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-2559e4d9-6ccf-4ed0-9fbc-bb416d1b6908 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:55.627225 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-2559e4d9-6ccf-4ed0-9fbc-bb416d1b6908 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: 874458f4-97d1-4e82-99fc-1af038d31220] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:55.633871 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2559e4d9-6ccf-4ed0-9fbc-bb416d1b6908 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:55.634324 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2559e4d9-6ccf-4ed0-9fbc-bb416d1b6908 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:55.635390 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2559e4d9-6ccf-4ed0-9fbc-bb416d1b6908 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:55.635835 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2559e4d9-6ccf-4ed0-9fbc-bb416d1b6908 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:55.710981 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-561a134f-4c0e-4192-b09e-fac3b8cc3355 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:55.711591 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-561a134f-4c0e-4192-b09e-fac3b8cc3355 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] [instance: 0664bc19-9eb0-4a77-82e1-9a359cae128d] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:55.718568 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-561a134f-4c0e-4192-b09e-fac3b8cc3355 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:55.719137 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-561a134f-4c0e-4192-b09e-fac3b8cc3355 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:55.719912 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-561a134f-4c0e-4192-b09e-fac3b8cc3355 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:55.720345 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-561a134f-4c0e-4192-b09e-fac3b8cc3355 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:55.746192 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2559e4d9-6ccf-4ed0-9fbc-bb416d1b6908 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f3a5742c42e6a1ddeb117df6f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea060bca7aa9440ba37d2093af6e9d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:55.756927 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-2559e4d9-6ccf-4ed0-9fbc-bb416d1b6908 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220" status: 200 len: 1210 microversion: 2.1 time: 0.135083 May 10 21:28:55.767640 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 447/895] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:28:55 2022] GET /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220 => generated 1210 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:55.786270 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-561a134f-4c0e-4192-b09e-fac3b8cc3355 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618beebad5b645c9a30632bd0677658e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95545f74981b44aeb69f246159088da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:55.793906 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-561a134f-4c0e-4192-b09e-fac3b8cc3355 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] 10.222.0.25 "GET /compute/v2.1/servers/0664bc19-9eb0-4a77-82e1-9a359cae128d" status: 200 len: 1289 microversion: 2.1 time: 0.086791 May 10 21:28:55.794526 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 449/896] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:28:55 2022] GET /compute/v2.1/servers/0664bc19-9eb0-4a77-82e1-9a359cae128d => generated 1289 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:28:56.775166 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-d58c7fa9-afd6-4c68-bd04-4197583e9d41 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:56.775865 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-d58c7fa9-afd6-4c68-bd04-4197583e9d41 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: 874458f4-97d1-4e82-99fc-1af038d31220] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:56.782630 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d58c7fa9-afd6-4c68-bd04-4197583e9d41 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:56.783068 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d58c7fa9-afd6-4c68-bd04-4197583e9d41 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:56.784017 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d58c7fa9-afd6-4c68-bd04-4197583e9d41 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:56.784448 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d58c7fa9-afd6-4c68-bd04-4197583e9d41 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:56.812453 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-72d659fa-0970-401f-a922-bc94dd3c36b8 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:56.813059 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-72d659fa-0970-401f-a922-bc94dd3c36b8 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] [instance: 0664bc19-9eb0-4a77-82e1-9a359cae128d] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:56.820023 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-72d659fa-0970-401f-a922-bc94dd3c36b8 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:56.820465 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-72d659fa-0970-401f-a922-bc94dd3c36b8 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:56.821227 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-72d659fa-0970-401f-a922-bc94dd3c36b8 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:56.821653 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-72d659fa-0970-401f-a922-bc94dd3c36b8 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:56.874980 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-d58c7fa9-afd6-4c68-bd04-4197583e9d41 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f3a5742c42e6a1ddeb117df6f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea060bca7aa9440ba37d2093af6e9d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:56.882554 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-d58c7fa9-afd6-4c68-bd04-4197583e9d41 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220" status: 200 len: 1272 microversion: 2.1 time: 0.111201 May 10 21:28:56.883146 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 448/897] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:28:56 2022] GET /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220 => generated 1272 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:56.956658 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-72d659fa-0970-401f-a922-bc94dd3c36b8 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618beebad5b645c9a30632bd0677658e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95545f74981b44aeb69f246159088da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:56.964129 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-72d659fa-0970-401f-a922-bc94dd3c36b8 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] 10.222.0.25 "GET /compute/v2.1/servers/0664bc19-9eb0-4a77-82e1-9a359cae128d" status: 200 len: 1319 microversion: 2.1 time: 0.155472 May 10 21:28:56.966176 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 450/898] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:28:56 2022] GET /compute/v2.1/servers/0664bc19-9eb0-4a77-82e1-9a359cae128d => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:57.403552 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-8f831149-6d93-4692-9eb7-2cea070465f9 req-5bbc6b0f-af2e-45c5-af62-8cfee29eee58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0664bc19-9eb0-4a77-82e1-9a359cae128d", "tag": "165129bc-4fec-4b69-b151-5cf1bccfaefa"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:28:57.412247 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-8f831149-6d93-4692-9eb7-2cea070465f9 req-5bbc6b0f-af2e-45c5-af62-8cfee29eee58 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:57.412683 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-8f831149-6d93-4692-9eb7-2cea070465f9 req-5bbc6b0f-af2e-45c5-af62-8cfee29eee58 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:57.423995 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-8f831149-6d93-4692-9eb7-2cea070465f9 req-5bbc6b0f-af2e-45c5-af62-8cfee29eee58 service nova] Creating event network-changed:165129bc-4fec-4b69-b151-5cf1bccfaefa for instance 0664bc19-9eb0-4a77-82e1-9a359cae128d on hv-cinder-83608 May 10 21:28:57.428814 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-8f831149-6d93-4692-9eb7-2cea070465f9 req-5bbc6b0f-af2e-45c5-af62-8cfee29eee58 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029109 May 10 21:28:57.429409 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 449/899] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:28:57.899273 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-61a38180-9875-47c0-8c1f-388edc9198c1 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:57.899873 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-61a38180-9875-47c0-8c1f-388edc9198c1 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: 874458f4-97d1-4e82-99fc-1af038d31220] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:57.907160 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-61a38180-9875-47c0-8c1f-388edc9198c1 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:57.907602 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-61a38180-9875-47c0-8c1f-388edc9198c1 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:57.908364 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-61a38180-9875-47c0-8c1f-388edc9198c1 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:57.908792 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-61a38180-9875-47c0-8c1f-388edc9198c1 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:57.954459 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 21:28:57.954673 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Tue May 10 21:28:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220 (ip 10.222.0.25) !!! May 10 21:28:57.985333 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-ef91c4e8-1481-41b7-bc12-49a707b70261 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:57.985981 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-ef91c4e8-1481-41b7-bc12-49a707b70261 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] [instance: 0664bc19-9eb0-4a77-82e1-9a359cae128d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:57.992563 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ef91c4e8-1481-41b7-bc12-49a707b70261 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:57.993021 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ef91c4e8-1481-41b7-bc12-49a707b70261 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:57.993832 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ef91c4e8-1481-41b7-bc12-49a707b70261 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:57.994273 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ef91c4e8-1481-41b7-bc12-49a707b70261 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:58.040652 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-61a38180-9875-47c0-8c1f-388edc9198c1 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f3a5742c42e6a1ddeb117df6f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea060bca7aa9440ba37d2093af6e9d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:58.048554 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-61a38180-9875-47c0-8c1f-388edc9198c1 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220" status: 200 len: 1314 microversion: 2.1 time: 0.153093 May 10 21:28:58.049121 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 451/900] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:28:57 2022] GET /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:58.269381 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-ef91c4e8-1481-41b7-bc12-49a707b70261 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618beebad5b645c9a30632bd0677658e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95545f74981b44aeb69f246159088da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:58.276859 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-ef91c4e8-1481-41b7-bc12-49a707b70261 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] 10.222.0.25 "GET /compute/v2.1/servers/0664bc19-9eb0-4a77-82e1-9a359cae128d" status: 200 len: 1319 microversion: 2.1 time: 0.299404 May 10 21:28:58.277568 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 450/901] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:28:57 2022] GET /compute/v2.1/servers/0664bc19-9eb0-4a77-82e1-9a359cae128d => generated 1319 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:59.065720 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-c268e0c5-99a8-445b-b6c2-178bb3cf27f1 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:59.066364 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-c268e0c5-99a8-445b-b6c2-178bb3cf27f1 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: 874458f4-97d1-4e82-99fc-1af038d31220] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:59.072708 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c268e0c5-99a8-445b-b6c2-178bb3cf27f1 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:59.073146 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c268e0c5-99a8-445b-b6c2-178bb3cf27f1 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:59.073895 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c268e0c5-99a8-445b-b6c2-178bb3cf27f1 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:59.074321 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c268e0c5-99a8-445b-b6c2-178bb3cf27f1 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:59.206089 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-c268e0c5-99a8-445b-b6c2-178bb3cf27f1 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f3a5742c42e6a1ddeb117df6f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea060bca7aa9440ba37d2093af6e9d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:59.213373 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-c268e0c5-99a8-445b-b6c2-178bb3cf27f1 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220" status: 200 len: 1314 microversion: 2.1 time: 0.151515 May 10 21:28:59.217256 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 452/902] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:28:59 2022] GET /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:59.294072 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-5bbb96fe-dd00-4b1a-9348-081379abd199 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:59.294853 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-5bbb96fe-dd00-4b1a-9348-081379abd199 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] [instance: 0664bc19-9eb0-4a77-82e1-9a359cae128d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:59.301767 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5bbb96fe-dd00-4b1a-9348-081379abd199 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:59.302221 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5bbb96fe-dd00-4b1a-9348-081379abd199 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:59.303042 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5bbb96fe-dd00-4b1a-9348-081379abd199 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:59.303477 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5bbb96fe-dd00-4b1a-9348-081379abd199 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:59.452760 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-22dec50b-effe-4e77-9fef-083107479087 req-c53a2d81-4152-489d-8805-4871de4a388d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "874458f4-97d1-4e82-99fc-1af038d31220", "tag": "a77ccf30-72ad-4fe8-9bcd-281bfc16f695"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:28:59.460956 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-22dec50b-effe-4e77-9fef-083107479087 req-c53a2d81-4152-489d-8805-4871de4a388d service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:59.461399 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-22dec50b-effe-4e77-9fef-083107479087 req-c53a2d81-4152-489d-8805-4871de4a388d service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:59.466397 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-5bbb96fe-dd00-4b1a-9348-081379abd199 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618beebad5b645c9a30632bd0677658e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95545f74981b44aeb69f246159088da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:59.473604 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-22dec50b-effe-4e77-9fef-083107479087 req-c53a2d81-4152-489d-8805-4871de4a388d service nova] Creating event network-changed:a77ccf30-72ad-4fe8-9bcd-281bfc16f695 for instance 874458f4-97d1-4e82-99fc-1af038d31220 on hv-cinder-83608 May 10 21:28:59.474764 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-5bbb96fe-dd00-4b1a-9348-081379abd199 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] 10.222.0.25 "GET /compute/v2.1/servers/0664bc19-9eb0-4a77-82e1-9a359cae128d" status: 200 len: 1319 microversion: 2.1 time: 0.184553 May 10 21:28:59.475348 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 451/903] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:28:59 2022] GET /compute/v2.1/servers/0664bc19-9eb0-4a77-82e1-9a359cae128d => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:59.478917 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-22dec50b-effe-4e77-9fef-083107479087 req-c53a2d81-4152-489d-8805-4871de4a388d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030318 May 10 21:28:59.479679 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 453/904] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:29:00.230690 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-9426cbf8-34ef-43ad-ac72-4fbc5fe27956 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:00.231301 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-9426cbf8-34ef-43ad-ac72-4fbc5fe27956 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: 874458f4-97d1-4e82-99fc-1af038d31220] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:00.237769 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9426cbf8-34ef-43ad-ac72-4fbc5fe27956 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:00.238245 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9426cbf8-34ef-43ad-ac72-4fbc5fe27956 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:00.239031 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9426cbf8-34ef-43ad-ac72-4fbc5fe27956 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:00.239456 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9426cbf8-34ef-43ad-ac72-4fbc5fe27956 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:00.492535 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-e3ded4bf-2365-4754-917e-180ceac534fa tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:00.493239 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-e3ded4bf-2365-4754-917e-180ceac534fa tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] [instance: 0664bc19-9eb0-4a77-82e1-9a359cae128d] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:00.499863 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e3ded4bf-2365-4754-917e-180ceac534fa tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:00.500310 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e3ded4bf-2365-4754-917e-180ceac534fa tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:00.501081 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e3ded4bf-2365-4754-917e-180ceac534fa tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:00.501517 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e3ded4bf-2365-4754-917e-180ceac534fa tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:00.535017 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-9426cbf8-34ef-43ad-ac72-4fbc5fe27956 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f3a5742c42e6a1ddeb117df6f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea060bca7aa9440ba37d2093af6e9d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:00.544026 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-9426cbf8-34ef-43ad-ac72-4fbc5fe27956 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220" status: 200 len: 1314 microversion: 2.1 time: 0.317092 May 10 21:29:00.550607 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 452/905] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:00 2022] GET /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:00.637464 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-e3ded4bf-2365-4754-917e-180ceac534fa tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618beebad5b645c9a30632bd0677658e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95545f74981b44aeb69f246159088da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:00.645706 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-e3ded4bf-2365-4754-917e-180ceac534fa tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] 10.222.0.25 "GET /compute/v2.1/servers/0664bc19-9eb0-4a77-82e1-9a359cae128d" status: 200 len: 1319 microversion: 2.1 time: 0.157728 May 10 21:29:00.646275 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 454/906] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:00 2022] GET /compute/v2.1/servers/0664bc19-9eb0-4a77-82e1-9a359cae128d => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:01.561316 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a50963f6-c6df-4d2f-b283-13b0b251597c tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:01.561948 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-a50963f6-c6df-4d2f-b283-13b0b251597c tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: 874458f4-97d1-4e82-99fc-1af038d31220] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:01.568504 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a50963f6-c6df-4d2f-b283-13b0b251597c tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:01.568945 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a50963f6-c6df-4d2f-b283-13b0b251597c tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:01.569703 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a50963f6-c6df-4d2f-b283-13b0b251597c tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:01.570129 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a50963f6-c6df-4d2f-b283-13b0b251597c tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:01.661268 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-95ad0976-eeca-4ffc-b5c8-273d1ba6b43a tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:01.661885 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-95ad0976-eeca-4ffc-b5c8-273d1ba6b43a tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] [instance: 0664bc19-9eb0-4a77-82e1-9a359cae128d] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:01.668218 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-95ad0976-eeca-4ffc-b5c8-273d1ba6b43a tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:01.668666 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-95ad0976-eeca-4ffc-b5c8-273d1ba6b43a tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:01.669437 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-95ad0976-eeca-4ffc-b5c8-273d1ba6b43a tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:01.669876 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-95ad0976-eeca-4ffc-b5c8-273d1ba6b43a tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:01.698546 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-a50963f6-c6df-4d2f-b283-13b0b251597c tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f3a5742c42e6a1ddeb117df6f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea060bca7aa9440ba37d2093af6e9d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:01.706392 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-a50963f6-c6df-4d2f-b283-13b0b251597c tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220" status: 200 len: 1314 microversion: 2.1 time: 0.149217 May 10 21:29:01.706981 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 453/907] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:01 2022] GET /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:01.796443 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-95ad0976-eeca-4ffc-b5c8-273d1ba6b43a tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618beebad5b645c9a30632bd0677658e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95545f74981b44aeb69f246159088da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:01.804533 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-95ad0976-eeca-4ffc-b5c8-273d1ba6b43a tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] 10.222.0.25 "GET /compute/v2.1/servers/0664bc19-9eb0-4a77-82e1-9a359cae128d" status: 200 len: 1319 microversion: 2.1 time: 0.147045 May 10 21:29:01.805090 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 455/908] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:01 2022] GET /compute/v2.1/servers/0664bc19-9eb0-4a77-82e1-9a359cae128d => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:02.505678 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-7da13360-5f95-4d84-a21d-42cdfccda650 req-407f4aaa-e17b-44c2-930c-abba2eb64eae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0664bc19-9eb0-4a77-82e1-9a359cae128d", "name": "network-vif-plugged", "status": "completed", "tag": "165129bc-4fec-4b69-b151-5cf1bccfaefa"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:29:02.514038 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-7da13360-5f95-4d84-a21d-42cdfccda650 req-407f4aaa-e17b-44c2-930c-abba2eb64eae service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:02.514642 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-7da13360-5f95-4d84-a21d-42cdfccda650 req-407f4aaa-e17b-44c2-930c-abba2eb64eae service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:02.525253 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-7da13360-5f95-4d84-a21d-42cdfccda650 req-407f4aaa-e17b-44c2-930c-abba2eb64eae service nova] Creating event network-vif-plugged:165129bc-4fec-4b69-b151-5cf1bccfaefa for instance 0664bc19-9eb0-4a77-82e1-9a359cae128d on hv-cinder-83608 May 10 21:29:02.530984 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-7da13360-5f95-4d84-a21d-42cdfccda650 req-407f4aaa-e17b-44c2-930c-abba2eb64eae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029014 May 10 21:29:02.531589 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 454/909] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:29:02.723969 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-daa063bf-133c-4540-8ecd-9ac3e44f7d3e tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:02.724578 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-daa063bf-133c-4540-8ecd-9ac3e44f7d3e tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: 874458f4-97d1-4e82-99fc-1af038d31220] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:02.731066 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-daa063bf-133c-4540-8ecd-9ac3e44f7d3e tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:02.731510 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-daa063bf-133c-4540-8ecd-9ac3e44f7d3e tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:02.732829 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-daa063bf-133c-4540-8ecd-9ac3e44f7d3e tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:02.733792 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-daa063bf-133c-4540-8ecd-9ac3e44f7d3e tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:02.822101 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6c7352b5-686d-4dd5-ae15-fcdecc23b009 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:02.822829 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-6c7352b5-686d-4dd5-ae15-fcdecc23b009 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] [instance: 0664bc19-9eb0-4a77-82e1-9a359cae128d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:02.834147 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6c7352b5-686d-4dd5-ae15-fcdecc23b009 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:02.834810 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6c7352b5-686d-4dd5-ae15-fcdecc23b009 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:02.835786 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6c7352b5-686d-4dd5-ae15-fcdecc23b009 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:02.836217 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6c7352b5-686d-4dd5-ae15-fcdecc23b009 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:02.887736 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-daa063bf-133c-4540-8ecd-9ac3e44f7d3e tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f3a5742c42e6a1ddeb117df6f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea060bca7aa9440ba37d2093af6e9d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:02.895753 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-daa063bf-133c-4540-8ecd-9ac3e44f7d3e tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220" status: 200 len: 1314 microversion: 2.1 time: 0.176237 May 10 21:29:02.896323 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 456/910] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:02 2022] GET /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:03.245462 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-6c7352b5-686d-4dd5-ae15-fcdecc23b009 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618beebad5b645c9a30632bd0677658e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95545f74981b44aeb69f246159088da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:03.253496 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-6c7352b5-686d-4dd5-ae15-fcdecc23b009 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] 10.222.0.25 "GET /compute/v2.1/servers/0664bc19-9eb0-4a77-82e1-9a359cae128d" status: 200 len: 1319 microversion: 2.1 time: 0.436099 May 10 21:29:03.254098 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 455/911] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:02 2022] GET /compute/v2.1/servers/0664bc19-9eb0-4a77-82e1-9a359cae128d => generated 1319 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:03.913115 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-05e0f4b1-b242-497c-bbf8-13f5e6edd3d7 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:03.913723 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-05e0f4b1-b242-497c-bbf8-13f5e6edd3d7 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: 874458f4-97d1-4e82-99fc-1af038d31220] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:03.920160 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-05e0f4b1-b242-497c-bbf8-13f5e6edd3d7 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:03.920572 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-05e0f4b1-b242-497c-bbf8-13f5e6edd3d7 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:03.921333 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-05e0f4b1-b242-497c-bbf8-13f5e6edd3d7 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:03.921764 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-05e0f4b1-b242-497c-bbf8-13f5e6edd3d7 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:04.048043 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-05e0f4b1-b242-497c-bbf8-13f5e6edd3d7 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f3a5742c42e6a1ddeb117df6f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea060bca7aa9440ba37d2093af6e9d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:04.055323 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-05e0f4b1-b242-497c-bbf8-13f5e6edd3d7 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220" status: 200 len: 1314 microversion: 2.1 time: 0.146120 May 10 21:29:04.055892 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 457/912] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:03 2022] GET /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:04.269677 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-7bcb8808-af18-4498-b7b3-cd5916f72364 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:04.270307 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-7bcb8808-af18-4498-b7b3-cd5916f72364 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] [instance: 0664bc19-9eb0-4a77-82e1-9a359cae128d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:04.277156 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7bcb8808-af18-4498-b7b3-cd5916f72364 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:04.277595 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7bcb8808-af18-4498-b7b3-cd5916f72364 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:04.278410 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7bcb8808-af18-4498-b7b3-cd5916f72364 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:04.278872 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7bcb8808-af18-4498-b7b3-cd5916f72364 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:04.413714 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-7bcb8808-af18-4498-b7b3-cd5916f72364 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618beebad5b645c9a30632bd0677658e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95545f74981b44aeb69f246159088da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:04.421219 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-7bcb8808-af18-4498-b7b3-cd5916f72364 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] 10.222.0.25 "GET /compute/v2.1/servers/0664bc19-9eb0-4a77-82e1-9a359cae128d" status: 200 len: 1319 microversion: 2.1 time: 0.155422 May 10 21:29:04.421792 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 456/913] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:04 2022] GET /compute/v2.1/servers/0664bc19-9eb0-4a77-82e1-9a359cae128d => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:04.546747 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-f3763025-d515-41ed-b94e-e443c8bc41ce req-38a18717-cc7c-4685-b107-9b9428a58a37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "874458f4-97d1-4e82-99fc-1af038d31220", "name": "network-vif-plugged", "status": "completed", "tag": "a77ccf30-72ad-4fe8-9bcd-281bfc16f695"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:29:04.554593 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-f3763025-d515-41ed-b94e-e443c8bc41ce req-38a18717-cc7c-4685-b107-9b9428a58a37 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:04.555037 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-f3763025-d515-41ed-b94e-e443c8bc41ce req-38a18717-cc7c-4685-b107-9b9428a58a37 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:04.570040 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-f3763025-d515-41ed-b94e-e443c8bc41ce req-38a18717-cc7c-4685-b107-9b9428a58a37 service nova] Creating event network-vif-plugged:a77ccf30-72ad-4fe8-9bcd-281bfc16f695 for instance 874458f4-97d1-4e82-99fc-1af038d31220 on hv-cinder-83608 May 10 21:29:04.575057 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-f3763025-d515-41ed-b94e-e443c8bc41ce req-38a18717-cc7c-4685-b107-9b9428a58a37 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031973 May 10 21:29:04.575649 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 458/914] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:29:05.072696 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6f4886e5-3d40-4250-bf77-33af0adb7284 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:05.073301 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-6f4886e5-3d40-4250-bf77-33af0adb7284 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: 874458f4-97d1-4e82-99fc-1af038d31220] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:05.079315 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6f4886e5-3d40-4250-bf77-33af0adb7284 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:05.079753 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6f4886e5-3d40-4250-bf77-33af0adb7284 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:05.080507 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6f4886e5-3d40-4250-bf77-33af0adb7284 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:05.080930 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6f4886e5-3d40-4250-bf77-33af0adb7284 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:05.207168 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-6f4886e5-3d40-4250-bf77-33af0adb7284 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f3a5742c42e6a1ddeb117df6f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea060bca7aa9440ba37d2093af6e9d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:05.214618 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-6f4886e5-3d40-4250-bf77-33af0adb7284 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220" status: 200 len: 1314 microversion: 2.1 time: 0.145692 May 10 21:29:05.215189 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 457/915] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:05 2022] GET /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:05.438319 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-fba7c2c8-059b-44c0-a13c-75095346f4c0 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:05.438954 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-fba7c2c8-059b-44c0-a13c-75095346f4c0 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] [instance: 0664bc19-9eb0-4a77-82e1-9a359cae128d] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:05.445066 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-fba7c2c8-059b-44c0-a13c-75095346f4c0 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:05.445505 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-fba7c2c8-059b-44c0-a13c-75095346f4c0 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:05.446261 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-fba7c2c8-059b-44c0-a13c-75095346f4c0 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:05.446725 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-fba7c2c8-059b-44c0-a13c-75095346f4c0 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:05.577140 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-fba7c2c8-059b-44c0-a13c-75095346f4c0 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618beebad5b645c9a30632bd0677658e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95545f74981b44aeb69f246159088da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:05.584348 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-fba7c2c8-059b-44c0-a13c-75095346f4c0 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] 10.222.0.25 "GET /compute/v2.1/servers/0664bc19-9eb0-4a77-82e1-9a359cae128d" status: 200 len: 1507 microversion: 2.1 time: 0.150728 May 10 21:29:05.584915 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 459/916] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:05 2022] GET /compute/v2.1/servers/0664bc19-9eb0-4a77-82e1-9a359cae128d => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:05.601201 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-82d41332-e3dc-4491-a586-dbc3236fa6dd tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ad5dcd0-3323-47ef-9c94-b7993e9d6505", "device": "/dev/sdb"}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:29:05.602289 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-82d41332-e3dc-4491-a586-dbc3236fa6dd tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] [instance: 0664bc19-9eb0-4a77-82e1-9a359cae128d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:05.608927 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-82d41332-e3dc-4491-a586-dbc3236fa6dd tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:05.609380 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-82d41332-e3dc-4491-a586-dbc3236fa6dd tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:05.610145 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-82d41332-e3dc-4491-a586-dbc3236fa6dd tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:05.610617 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-82d41332-e3dc-4491-a586-dbc3236fa6dd tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:06.232576 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-d2049d95-c238-4f70-89b2-50a170fc88d6 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:06.233621 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-d2049d95-c238-4f70-89b2-50a170fc88d6 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: 874458f4-97d1-4e82-99fc-1af038d31220] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:06.239553 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d2049d95-c238-4f70-89b2-50a170fc88d6 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:06.239994 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d2049d95-c238-4f70-89b2-50a170fc88d6 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:06.240754 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d2049d95-c238-4f70-89b2-50a170fc88d6 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:06.241179 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d2049d95-c238-4f70-89b2-50a170fc88d6 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:06.375863 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-d2049d95-c238-4f70-89b2-50a170fc88d6 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f3a5742c42e6a1ddeb117df6f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea060bca7aa9440ba37d2093af6e9d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:06.383124 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-d2049d95-c238-4f70-89b2-50a170fc88d6 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220" status: 200 len: 1314 microversion: 2.1 time: 0.155118 May 10 21:29:06.383694 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 460/917] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:06 2022] GET /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:06.677303 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-82d41332-e3dc-4491-a586-dbc3236fa6dd tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] 10.222.0.25 "POST /compute/v2.1/servers/0664bc19-9eb0-4a77-82e1-9a359cae128d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.079858 May 10 21:29:06.677968 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 458/918] 10.222.0.25 () {60 vars in 1322 bytes} [Tue May 10 21:29:05 2022] POST /compute/v2.1/servers/0664bc19-9eb0-4a77-82e1-9a359cae128d/os-volume_attachments => generated 194 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:29:07.399980 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-d814b572-1c53-4a19-aa15-d9f224635c78 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:07.400590 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-d814b572-1c53-4a19-aa15-d9f224635c78 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: 874458f4-97d1-4e82-99fc-1af038d31220] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:07.407436 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d814b572-1c53-4a19-aa15-d9f224635c78 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:07.407879 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d814b572-1c53-4a19-aa15-d9f224635c78 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:07.408636 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d814b572-1c53-4a19-aa15-d9f224635c78 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:07.409066 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d814b572-1c53-4a19-aa15-d9f224635c78 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:07.533387 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-d814b572-1c53-4a19-aa15-d9f224635c78 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f3a5742c42e6a1ddeb117df6f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea060bca7aa9440ba37d2093af6e9d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:07.540701 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-d814b572-1c53-4a19-aa15-d9f224635c78 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220" status: 200 len: 1497 microversion: 2.1 time: 0.144553 May 10 21:29:07.541267 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 461/919] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:07 2022] GET /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220 => generated 1497 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:08.338707 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-f42c7cfb-0b68-4e80-8296-6b16c72d3a08 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:08.342181 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-f42c7cfb-0b68-4e80-8296-6b16c72d3a08 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: 874458f4-97d1-4e82-99fc-1af038d31220] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:08.346215 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f42c7cfb-0b68-4e80-8296-6b16c72d3a08 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:08.346695 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f42c7cfb-0b68-4e80-8296-6b16c72d3a08 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:08.347459 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f42c7cfb-0b68-4e80-8296-6b16c72d3a08 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:08.347890 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f42c7cfb-0b68-4e80-8296-6b16c72d3a08 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:08.373336 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-f42c7cfb-0b68-4e80-8296-6b16c72d3a08 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: 874458f4-97d1-4e82-99fc-1af038d31220] Going to try to terminate instance {{(pid=117679) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 21:29:08.713610 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-f42c7cfb-0b68-4e80-8296-6b16c72d3a08 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "DELETE /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220" status: 204 len: 0 microversion: 2.1 time: 0.379295 May 10 21:29:08.714204 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 459/920] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 10 21:29:08 2022] DELETE /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 21:29:08.723151 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-f29286c8-797b-43af-9459-6be462f9b4ee tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:08.723757 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-f29286c8-797b-43af-9459-6be462f9b4ee tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: 874458f4-97d1-4e82-99fc-1af038d31220] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:08.730163 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f29286c8-797b-43af-9459-6be462f9b4ee tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:08.731411 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f29286c8-797b-43af-9459-6be462f9b4ee tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:08.731520 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f29286c8-797b-43af-9459-6be462f9b4ee tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:08.731884 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f29286c8-797b-43af-9459-6be462f9b4ee tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:08.870584 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-f29286c8-797b-43af-9459-6be462f9b4ee tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f3a5742c42e6a1ddeb117df6f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea060bca7aa9440ba37d2093af6e9d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:08.882396 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-f29286c8-797b-43af-9459-6be462f9b4ee tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220" status: 200 len: 1503 microversion: 2.1 time: 0.163046 May 10 21:29:08.883011 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 462/921] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:08 2022] GET /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220 => generated 1503 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:09.906587 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6a27e188-5680-48f3-90c2-3b6d21ac5e6d tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:09.907290 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-6a27e188-5680-48f3-90c2-3b6d21ac5e6d tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: 874458f4-97d1-4e82-99fc-1af038d31220] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:09.913520 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6a27e188-5680-48f3-90c2-3b6d21ac5e6d tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:09.914049 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6a27e188-5680-48f3-90c2-3b6d21ac5e6d tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:09.915452 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6a27e188-5680-48f3-90c2-3b6d21ac5e6d tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:09.920561 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6a27e188-5680-48f3-90c2-3b6d21ac5e6d tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:10.059482 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-6a27e188-5680-48f3-90c2-3b6d21ac5e6d tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f3a5742c42e6a1ddeb117df6f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea060bca7aa9440ba37d2093af6e9d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:10.067697 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-6a27e188-5680-48f3-90c2-3b6d21ac5e6d tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220" status: 200 len: 1503 microversion: 2.1 time: 0.166310 May 10 21:29:10.068260 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 460/922] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:09 2022] GET /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220 => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:10.608941 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-0b25d724-f4f1-4f0a-b493-4f6078cf69b5 req-30619af5-3329-44f2-87df-9cf05b29f8a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "874458f4-97d1-4e82-99fc-1af038d31220", "name": "network-vif-deleted", "tag": "a77ccf30-72ad-4fe8-9bcd-281bfc16f695"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:29:10.617487 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-0b25d724-f4f1-4f0a-b493-4f6078cf69b5 req-30619af5-3329-44f2-87df-9cf05b29f8a4 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:10.617921 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-0b25d724-f4f1-4f0a-b493-4f6078cf69b5 req-30619af5-3329-44f2-87df-9cf05b29f8a4 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:10.628937 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-0b25d724-f4f1-4f0a-b493-4f6078cf69b5 req-30619af5-3329-44f2-87df-9cf05b29f8a4 service nova] Creating event network-vif-deleted:a77ccf30-72ad-4fe8-9bcd-281bfc16f695 for instance 874458f4-97d1-4e82-99fc-1af038d31220 on hv-cinder-83608 May 10 21:29:10.633904 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-0b25d724-f4f1-4f0a-b493-4f6078cf69b5 req-30619af5-3329-44f2-87df-9cf05b29f8a4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029389 May 10 21:29:10.634504 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 463/923] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:29:11.084324 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-50fc0578-4673-4a38-88af-03459b83d797 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:11.084931 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-50fc0578-4673-4a38-88af-03459b83d797 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: 874458f4-97d1-4e82-99fc-1af038d31220] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:11.091316 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-50fc0578-4673-4a38-88af-03459b83d797 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:11.092383 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-50fc0578-4673-4a38-88af-03459b83d797 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:11.093167 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-50fc0578-4673-4a38-88af-03459b83d797 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:11.093594 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-50fc0578-4673-4a38-88af-03459b83d797 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:11.123303 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-50fc0578-4673-4a38-88af-03459b83d797 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:11.123742 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-50fc0578-4673-4a38-88af-03459b83d797 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:11.124177 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.objects.instance [None req-50fc0578-4673-4a38-88af-03459b83d797 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lazy-loading 'fault' on Instance uuid 874458f4-97d1-4e82-99fc-1af038d31220 {{(pid=117679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:29:11.165373 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-50fc0578-4673-4a38-88af-03459b83d797 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f3a5742c42e6a1ddeb117df6f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea060bca7aa9440ba37d2093af6e9d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:11.173798 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-50fc0578-4673-4a38-88af-03459b83d797 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220" status: 200 len: 1304 microversion: 2.1 time: 0.093376 May 10 21:29:11.174369 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 461/924] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:11 2022] GET /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220 => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:12.192621 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-3f1c5487-1d01-4f1d-8825-3f0dce23e6ab tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:12.193320 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-3f1c5487-1d01-4f1d-8825-3f0dce23e6ab tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: 874458f4-97d1-4e82-99fc-1af038d31220] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:12.199442 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3f1c5487-1d01-4f1d-8825-3f0dce23e6ab tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:12.199885 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3f1c5487-1d01-4f1d-8825-3f0dce23e6ab tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:12.200641 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3f1c5487-1d01-4f1d-8825-3f0dce23e6ab tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:12.201219 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3f1c5487-1d01-4f1d-8825-3f0dce23e6ab tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:12.214334 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.wsgi [None req-3f1c5487-1d01-4f1d-8825-3f0dce23e6ab tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] HTTP exception thrown: Instance 874458f4-97d1-4e82-99fc-1af038d31220 could not be found. May 10 21:29:12.215951 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-3f1c5487-1d01-4f1d-8825-3f0dce23e6ab tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Request method failure captured: May 10 21:29:12.215951 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: request: GET /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220 HTTP/1.1 May 10 21:29:12.215951 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept: application/json May 10 21:29:12.215951 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept-Encoding: identity May 10 21:29:12.215951 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Connection: close May 10 21:29:12.215951 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Length: 0 May 10 21:29:12.215951 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Type: application/json May 10 21:29:12.215951 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Host: 10.222.0.25 May 10 21:29:12.215951 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Openstack-System-Scope: None May 10 21:29:12.215951 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: User-Agent: python-urllib3/1.26.9 May 10 21:29:12.215951 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Auth-Token: gAAAAABietkPa7ZCRSWSKMKTS7tFL25xPBpfEoGaNERlGRTq7Llk0-FyLRGktSlx6tKYK13Zis-CE1z5Ynss_R1rABKFbYFHLU61mJU8o-t6uiSZywe6ikN_RvaKJVoK471SntnovR3LDrMH7dhppuAiQReTSxsVynIPbqRBjSil-W13avpE7CI May 10 21:29:12.215951 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Id: None May 10 21:29:12.215951 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Name: None May 10 21:29:12.215951 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Identity-Status: Confirmed May 10 21:29:12.215951 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Is-Admin-Project: True May 10 21:29:12.215951 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Id: default May 10 21:29:12.215951 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Name: Default May 10 21:29:12.215951 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Id: ea060bca7aa9440ba37d2093af6e9d16 May 10 21:29:12.215951 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Name: tempest-VolumesActionsTest-1443750451 May 10 21:29:12.215951 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Role: member,reader May 10 21:29:12.215951 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Roles: member,reader May 10 21:29:12.217915 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ea060bca7aa9440ba37d2093af6e9d16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ea060bca7aa9440ba37d2093af6e9d16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ea060bca7aa9440ba37d2093af6e9d16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ea060bca7aa9440ba37d2093af6e9d16"}]}] May 10 21:29:12.217915 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant: tempest-VolumesActionsTest-1443750451 May 10 21:29:12.217915 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Id: ea060bca7aa9440ba37d2093af6e9d16 May 10 21:29:12.217915 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Name: tempest-VolumesActionsTest-1443750451 May 10 21:29:12.217915 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User: tempest-VolumesActionsTest-1443750451-project May 10 21:29:12.217915 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Id: default May 10 21:29:12.217915 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Name: Default May 10 21:29:12.217915 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Id: ca75f3a5742c42e6a1ddeb117df6f01e May 10 21:29:12.217915 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Name: tempest-VolumesActionsTest-1443750451-project May 10 21:29:12.217915 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: method: > May 10 21:29:12.217915 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: exception: Instance 874458f4-97d1-4e82-99fc-1af038d31220 could not be found. May 10 21:29:12.217915 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: action_args: {'id': '874458f4-97d1-4e82-99fc-1af038d31220'} May 10 21:29:12.218953 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:29:12.218953 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:29:12.218953 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:29:12.218953 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:29:12.218953 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:29:12.218953 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:29:12.218953 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:29:12.218953 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:29:12.218953 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:29:12.218953 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:29:12.218953 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 874458f4-97d1-4e82-99fc-1af038d31220 could not be found. May 10 21:29:12.218953 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:29:12.218953 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:29:12.218953 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:29:12.218953 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:29:12.218953 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:29:12.218953 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:29:12.218953 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:29:12.218953 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:29:12.218953 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:29:12.220557 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:29:12.220557 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:29:12.220557 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:29:12.220557 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:29:12.220557 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:29:12.220557 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:29:12.220557 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:29:12.220557 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 874458f4-97d1-4e82-99fc-1af038d31220 could not be found. May 10 21:29:12.220557 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:29:12.220557 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:29:12.220557 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:29:12.220557 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:29:12.220557 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:29:12.220557 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:29:12.220557 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:29:12.220557 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:29:12.220557 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 874458f4-97d1-4e82-99fc-1af038d31220 could not be found. May 10 21:29:12.220557 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:29:12.222095 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-3f1c5487-1d01-4f1d-8825-3f0dce23e6ab tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Returning 404 to user: Instance 874458f4-97d1-4e82-99fc-1af038d31220 could not be found. {{(pid=117678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:29:12.222095 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-3f1c5487-1d01-4f1d-8825-3f0dce23e6ab tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220" status: 404 len: 111 microversion: 2.1 time: 0.029443 May 10 21:29:12.222095 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 464/925] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:12 2022] GET /compute/v2.1/servers/874458f4-97d1-4e82-99fc-1af038d31220 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 21:29:12.265193 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-b0bc096a-a8ee-4587-a4a7-ab4bc2af1f43 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-244655007", "imageRef": "2d72b3e0-7d02-481e-b5e6-17f44e8729d6", "flavorRef": "452", "networks": [{"uuid": "7bf18228-0ae0-4bdb-9da9-418eb8cadc32"}]}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:29:12.315521 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.network.neutron [None req-b0bc096a-a8ee-4587-a4a7-ab4bc2af1f43 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] validate_networks() for [('7bf18228-0ae0-4bdb-9da9-418eb8cadc32', None, None, None, None, None)] {{(pid=117679) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 21:29:12.659513 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-b0bc096a-a8ee-4587-a4a7-ab4bc2af1f43 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Flavor limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 21:29:12.659937 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-b0bc096a-a8ee-4587-a4a7-ab4bc2af1f43 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Image limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 21:29:12.660408 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-b0bc096a-a8ee-4587-a4a7-ab4bc2af1f43 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Flavor pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 21:29:12.660813 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-b0bc096a-a8ee-4587-a4a7-ab4bc2af1f43 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Image pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 21:29:12.661218 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-b0bc096a-a8ee-4587-a4a7-ab4bc2af1f43 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 21:29:12.671019 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b0bc096a-a8ee-4587-a4a7-ab4bc2af1f43 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:12.671467 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b0bc096a-a8ee-4587-a4a7-ab4bc2af1f43 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:12.672265 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b0bc096a-a8ee-4587-a4a7-ab4bc2af1f43 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:12.672697 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b0bc096a-a8ee-4587-a4a7-ab4bc2af1f43 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:12.689220 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-b0bc096a-a8ee-4587-a4a7-ab4bc2af1f43 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Getting quotas for project ea060bca7aa9440ba37d2093af6e9d16. Resources: {'cores', 'instances', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:29:12.693268 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-b0bc096a-a8ee-4587-a4a7-ab4bc2af1f43 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Getting quotas for user ca75f3a5742c42e6a1ddeb117df6f01e and project ea060bca7aa9440ba37d2093af6e9d16. Resources: {'cores', 'instances', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:29:12.704374 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-b0bc096a-a8ee-4587-a4a7-ab4bc2af1f43 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Going to run 1 instances... {{(pid=117679) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 21:29:12.706671 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-b0bc096a-a8ee-4587-a4a7-ab4bc2af1f43 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: be10fb2e-2e0a-4c03-980c-c4dfcbb563f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d72b3e0-7d02-481e-b5e6-17f44e8729d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 21:29:12.824217 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-b0bc096a-a8ee-4587-a4a7-ab4bc2af1f43 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.562750 May 10 21:29:12.824793 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 462/926] 10.222.0.25 () {60 vars in 1146 bytes} [Tue May 10 21:29:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 21:29:12.834993 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-0801c8b2-fcb7-4b09-90f9-5ad576193a6b tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:12.835608 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-0801c8b2-fcb7-4b09-90f9-5ad576193a6b tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: be10fb2e-2e0a-4c03-980c-c4dfcbb563f4] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:12.888767 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-0801c8b2-fcb7-4b09-90f9-5ad576193a6b tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f3a5742c42e6a1ddeb117df6f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea060bca7aa9440ba37d2093af6e9d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:12.895994 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-0801c8b2-fcb7-4b09-90f9-5ad576193a6b tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4" status: 200 len: 1213 microversion: 2.1 time: 0.064838 May 10 21:29:12.896596 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 465/927] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:12 2022] GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4 => generated 1213 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:13.914403 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-559e29c0-8c1c-481a-9f61-2dcfd376ae86 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:13.915049 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-559e29c0-8c1c-481a-9f61-2dcfd376ae86 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: be10fb2e-2e0a-4c03-980c-c4dfcbb563f4] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:13.921757 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-559e29c0-8c1c-481a-9f61-2dcfd376ae86 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:13.922148 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-559e29c0-8c1c-481a-9f61-2dcfd376ae86 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:13.923023 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-559e29c0-8c1c-481a-9f61-2dcfd376ae86 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:13.923476 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-559e29c0-8c1c-481a-9f61-2dcfd376ae86 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:13.984963 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-559e29c0-8c1c-481a-9f61-2dcfd376ae86 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f3a5742c42e6a1ddeb117df6f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea060bca7aa9440ba37d2093af6e9d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:13.992426 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-559e29c0-8c1c-481a-9f61-2dcfd376ae86 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4" status: 200 len: 1217 microversion: 2.1 time: 0.082380 May 10 21:29:13.992995 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 463/928] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:13 2022] GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4 => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:15.009064 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-9448b831-4a9e-43f4-b20a-5e221dba14b5 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:15.009804 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-9448b831-4a9e-43f4-b20a-5e221dba14b5 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: be10fb2e-2e0a-4c03-980c-c4dfcbb563f4] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:15.017356 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9448b831-4a9e-43f4-b20a-5e221dba14b5 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:15.017868 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9448b831-4a9e-43f4-b20a-5e221dba14b5 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:15.018724 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9448b831-4a9e-43f4-b20a-5e221dba14b5 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:15.019220 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9448b831-4a9e-43f4-b20a-5e221dba14b5 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:15.081562 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-9448b831-4a9e-43f4-b20a-5e221dba14b5 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f3a5742c42e6a1ddeb117df6f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea060bca7aa9440ba37d2093af6e9d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:15.089038 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-9448b831-4a9e-43f4-b20a-5e221dba14b5 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4" status: 200 len: 1271 microversion: 2.1 time: 0.083831 May 10 21:29:15.091801 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 466/929] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:15 2022] GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4 => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:16.106607 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4b59187e-a4df-4910-930b-ca6a4971b949 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:16.107221 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-4b59187e-a4df-4910-930b-ca6a4971b949 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: be10fb2e-2e0a-4c03-980c-c4dfcbb563f4] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:16.114089 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4b59187e-a4df-4910-930b-ca6a4971b949 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:16.114565 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4b59187e-a4df-4910-930b-ca6a4971b949 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:16.115332 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4b59187e-a4df-4910-930b-ca6a4971b949 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:16.115773 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4b59187e-a4df-4910-930b-ca6a4971b949 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:16.247872 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-4b59187e-a4df-4910-930b-ca6a4971b949 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f3a5742c42e6a1ddeb117df6f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea060bca7aa9440ba37d2093af6e9d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:16.255456 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4b59187e-a4df-4910-930b-ca6a4971b949 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4" status: 200 len: 1313 microversion: 2.1 time: 0.152748 May 10 21:29:16.256021 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 464/930] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:16 2022] GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:17.272863 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-2f6aeb78-0ae6-4d20-a61e-2fdc44badf33 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:17.273476 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-2f6aeb78-0ae6-4d20-a61e-2fdc44badf33 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: be10fb2e-2e0a-4c03-980c-c4dfcbb563f4] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:17.280400 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2f6aeb78-0ae6-4d20-a61e-2fdc44badf33 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:17.281033 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2f6aeb78-0ae6-4d20-a61e-2fdc44badf33 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:17.282336 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2f6aeb78-0ae6-4d20-a61e-2fdc44badf33 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:17.283010 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-2f6aeb78-0ae6-4d20-a61e-2fdc44badf33 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:17.411825 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-2f6aeb78-0ae6-4d20-a61e-2fdc44badf33 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f3a5742c42e6a1ddeb117df6f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea060bca7aa9440ba37d2093af6e9d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:17.419006 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-2f6aeb78-0ae6-4d20-a61e-2fdc44badf33 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4" status: 200 len: 1313 microversion: 2.1 time: 0.150090 May 10 21:29:17.419564 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 467/931] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:17 2022] GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:18.246190 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-c2e935b4-aeef-4d9d-8ebd-8b65e458e7eb req-1995e8a6-a3b5-48e7-b869-705a0b107e6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be10fb2e-2e0a-4c03-980c-c4dfcbb563f4", "tag": "4cee6493-96ab-49cc-acbd-c243ce44c492"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:29:18.255361 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-c2e935b4-aeef-4d9d-8ebd-8b65e458e7eb req-1995e8a6-a3b5-48e7-b869-705a0b107e6b service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:18.257882 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-c2e935b4-aeef-4d9d-8ebd-8b65e458e7eb req-1995e8a6-a3b5-48e7-b869-705a0b107e6b service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:18.267663 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-c2e935b4-aeef-4d9d-8ebd-8b65e458e7eb req-1995e8a6-a3b5-48e7-b869-705a0b107e6b service nova] Creating event network-changed:4cee6493-96ab-49cc-acbd-c243ce44c492 for instance be10fb2e-2e0a-4c03-980c-c4dfcbb563f4 on hv-cinder-83608 May 10 21:29:18.272548 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-c2e935b4-aeef-4d9d-8ebd-8b65e458e7eb req-1995e8a6-a3b5-48e7-b869-705a0b107e6b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029976 May 10 21:29:18.273140 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 465/932] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:29:18.436062 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-241bf0e8-5d52-4669-a8a3-1ea015bdd892 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:18.436780 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-241bf0e8-5d52-4669-a8a3-1ea015bdd892 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: be10fb2e-2e0a-4c03-980c-c4dfcbb563f4] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:18.443322 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-241bf0e8-5d52-4669-a8a3-1ea015bdd892 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:18.443855 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-241bf0e8-5d52-4669-a8a3-1ea015bdd892 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:18.444645 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-241bf0e8-5d52-4669-a8a3-1ea015bdd892 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:18.445072 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-241bf0e8-5d52-4669-a8a3-1ea015bdd892 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:18.584090 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-241bf0e8-5d52-4669-a8a3-1ea015bdd892 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f3a5742c42e6a1ddeb117df6f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea060bca7aa9440ba37d2093af6e9d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:18.591725 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-241bf0e8-5d52-4669-a8a3-1ea015bdd892 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4" status: 200 len: 1313 microversion: 2.1 time: 0.159416 May 10 21:29:18.592620 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 468/933] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:18 2022] GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:19.611009 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-adddad5f-d47a-469c-94f6-755e6bb2c34a tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:19.611736 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-adddad5f-d47a-469c-94f6-755e6bb2c34a tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: be10fb2e-2e0a-4c03-980c-c4dfcbb563f4] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:19.617846 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-adddad5f-d47a-469c-94f6-755e6bb2c34a tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:19.618289 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-adddad5f-d47a-469c-94f6-755e6bb2c34a tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:19.619080 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-adddad5f-d47a-469c-94f6-755e6bb2c34a tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:19.619511 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-adddad5f-d47a-469c-94f6-755e6bb2c34a tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:19.745920 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-adddad5f-d47a-469c-94f6-755e6bb2c34a tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f3a5742c42e6a1ddeb117df6f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea060bca7aa9440ba37d2093af6e9d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:19.753153 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-adddad5f-d47a-469c-94f6-755e6bb2c34a tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4" status: 200 len: 1313 microversion: 2.1 time: 0.147362 May 10 21:29:19.753721 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 466/934] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:19 2022] GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:20.769741 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-113f2cd4-bf3e-4fb8-938d-b8e2e3809cf4 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:20.770341 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-113f2cd4-bf3e-4fb8-938d-b8e2e3809cf4 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: be10fb2e-2e0a-4c03-980c-c4dfcbb563f4] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:20.776709 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-113f2cd4-bf3e-4fb8-938d-b8e2e3809cf4 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:20.777148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-113f2cd4-bf3e-4fb8-938d-b8e2e3809cf4 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:20.777899 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-113f2cd4-bf3e-4fb8-938d-b8e2e3809cf4 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:20.778323 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-113f2cd4-bf3e-4fb8-938d-b8e2e3809cf4 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:20.910162 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-113f2cd4-bf3e-4fb8-938d-b8e2e3809cf4 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f3a5742c42e6a1ddeb117df6f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea060bca7aa9440ba37d2093af6e9d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:20.917350 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-113f2cd4-bf3e-4fb8-938d-b8e2e3809cf4 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4" status: 200 len: 1313 microversion: 2.1 time: 0.151602 May 10 21:29:20.917906 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 469/935] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:20 2022] GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:21.935027 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-70c32197-c65c-4f72-81f6-ee39d74e9f7b tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:21.944802 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-70c32197-c65c-4f72-81f6-ee39d74e9f7b tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: be10fb2e-2e0a-4c03-980c-c4dfcbb563f4] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:21.944802 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-70c32197-c65c-4f72-81f6-ee39d74e9f7b tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:21.944802 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-70c32197-c65c-4f72-81f6-ee39d74e9f7b tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:21.944802 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-70c32197-c65c-4f72-81f6-ee39d74e9f7b tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:21.945203 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-70c32197-c65c-4f72-81f6-ee39d74e9f7b tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:22.073699 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-70c32197-c65c-4f72-81f6-ee39d74e9f7b tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f3a5742c42e6a1ddeb117df6f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea060bca7aa9440ba37d2093af6e9d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:22.081607 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-70c32197-c65c-4f72-81f6-ee39d74e9f7b tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4" status: 200 len: 1313 microversion: 2.1 time: 0.150653 May 10 21:29:22.082163 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 467/936] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:21 2022] GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:23.098925 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-035c0714-1a68-4943-ba85-0d9b49ea8188 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:23.099542 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-035c0714-1a68-4943-ba85-0d9b49ea8188 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: be10fb2e-2e0a-4c03-980c-c4dfcbb563f4] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:23.105860 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-035c0714-1a68-4943-ba85-0d9b49ea8188 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:23.106311 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-035c0714-1a68-4943-ba85-0d9b49ea8188 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:23.107118 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-035c0714-1a68-4943-ba85-0d9b49ea8188 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:23.107554 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-035c0714-1a68-4943-ba85-0d9b49ea8188 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:23.237775 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-035c0714-1a68-4943-ba85-0d9b49ea8188 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f3a5742c42e6a1ddeb117df6f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea060bca7aa9440ba37d2093af6e9d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:23.245264 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-035c0714-1a68-4943-ba85-0d9b49ea8188 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4" status: 200 len: 1313 microversion: 2.1 time: 0.150824 May 10 21:29:23.245829 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 470/937] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:23 2022] GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:24.262477 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-742431f3-3ef7-4d5e-891e-cb14aed7c50b tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:24.263086 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-742431f3-3ef7-4d5e-891e-cb14aed7c50b tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: be10fb2e-2e0a-4c03-980c-c4dfcbb563f4] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:24.269874 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-742431f3-3ef7-4d5e-891e-cb14aed7c50b tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:24.270316 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-742431f3-3ef7-4d5e-891e-cb14aed7c50b tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:24.271153 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-742431f3-3ef7-4d5e-891e-cb14aed7c50b tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:24.271578 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-742431f3-3ef7-4d5e-891e-cb14aed7c50b tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:24.400842 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-742431f3-3ef7-4d5e-891e-cb14aed7c50b tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f3a5742c42e6a1ddeb117df6f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea060bca7aa9440ba37d2093af6e9d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:24.409542 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-742431f3-3ef7-4d5e-891e-cb14aed7c50b tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4" status: 200 len: 1313 microversion: 2.1 time: 0.151109 May 10 21:29:24.410111 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 468/938] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:24 2022] GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:25.426553 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-a1e9d312-7c2c-43b9-b738-e5806e96b601 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:25.432747 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-a1e9d312-7c2c-43b9-b738-e5806e96b601 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: be10fb2e-2e0a-4c03-980c-c4dfcbb563f4] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:25.433613 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-a1e9d312-7c2c-43b9-b738-e5806e96b601 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:25.434053 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-a1e9d312-7c2c-43b9-b738-e5806e96b601 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:25.434831 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-a1e9d312-7c2c-43b9-b738-e5806e96b601 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:25.435258 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-a1e9d312-7c2c-43b9-b738-e5806e96b601 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:25.566488 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-a1e9d312-7c2c-43b9-b738-e5806e96b601 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f3a5742c42e6a1ddeb117df6f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea060bca7aa9440ba37d2093af6e9d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:25.573806 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-a1e9d312-7c2c-43b9-b738-e5806e96b601 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4" status: 200 len: 1313 microversion: 2.1 time: 0.151068 May 10 21:29:25.574378 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 471/939] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:25 2022] GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:26.543497 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-9004ef6b-46c9-49ba-badc-518ec1ae9e1b tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:26.543993 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-9004ef6b-46c9-49ba-badc-518ec1ae9e1b tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] [instance: 0664bc19-9eb0-4a77-82e1-9a359cae128d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:26.550778 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9004ef6b-46c9-49ba-badc-518ec1ae9e1b tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:26.551218 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9004ef6b-46c9-49ba-badc-518ec1ae9e1b tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:26.551972 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9004ef6b-46c9-49ba-badc-518ec1ae9e1b tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:26.552401 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9004ef6b-46c9-49ba-badc-518ec1ae9e1b tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:26.590371 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-e6da64cc-b1b2-4d59-be34-d20b90ef63f0 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:26.592421 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-e6da64cc-b1b2-4d59-be34-d20b90ef63f0 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: be10fb2e-2e0a-4c03-980c-c4dfcbb563f4] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:26.597389 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e6da64cc-b1b2-4d59-be34-d20b90ef63f0 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:26.597837 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e6da64cc-b1b2-4d59-be34-d20b90ef63f0 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:26.598640 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e6da64cc-b1b2-4d59-be34-d20b90ef63f0 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:26.599074 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e6da64cc-b1b2-4d59-be34-d20b90ef63f0 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:26.631016 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.objects.instance [None req-9004ef6b-46c9-49ba-badc-518ec1ae9e1b tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lazy-loading 'services' on Instance uuid 0664bc19-9eb0-4a77-82e1-9a359cae128d {{(pid=117679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:29:26.728631 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-e6da64cc-b1b2-4d59-be34-d20b90ef63f0 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f3a5742c42e6a1ddeb117df6f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea060bca7aa9440ba37d2093af6e9d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:26.736552 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-e6da64cc-b1b2-4d59-be34-d20b90ef63f0 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4" status: 200 len: 1313 microversion: 2.1 time: 0.150004 May 10 21:29:26.737126 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 472/940] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:26 2022] GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:26.855560 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-9004ef6b-46c9-49ba-badc-518ec1ae9e1b tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0664bc19-9eb0-4a77-82e1-9a359cae128d/os-volume_attachments/5ad5dcd0-3323-47ef-9c94-b7993e9d6505" status: 202 len: 0 microversion: 2.1 time: 0.315804 May 10 21:29:26.856148 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 469/941] 10.222.0.25 () {58 vars in 1415 bytes} [Tue May 10 21:29:26 2022] DELETE /compute/v2.1/servers/0664bc19-9eb0-4a77-82e1-9a359cae128d/os-volume_attachments/5ad5dcd0-3323-47ef-9c94-b7993e9d6505 => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 21:29:27.708043 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-d4eae648-de23-41c9-9075-c440a97b1843 req-32387256-bcc7-48ea-ba7d-5099a491c9f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be10fb2e-2e0a-4c03-980c-c4dfcbb563f4", "name": "network-vif-plugged", "status": "completed", "tag": "4cee6493-96ab-49cc-acbd-c243ce44c492"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:29:27.717133 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-d4eae648-de23-41c9-9075-c440a97b1843 req-32387256-bcc7-48ea-ba7d-5099a491c9f6 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:27.717576 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-d4eae648-de23-41c9-9075-c440a97b1843 req-32387256-bcc7-48ea-ba7d-5099a491c9f6 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:27.729595 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-d4eae648-de23-41c9-9075-c440a97b1843 req-32387256-bcc7-48ea-ba7d-5099a491c9f6 service nova] Creating event network-vif-plugged:4cee6493-96ab-49cc-acbd-c243ce44c492 for instance be10fb2e-2e0a-4c03-980c-c4dfcbb563f4 on hv-cinder-83608 May 10 21:29:27.734835 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-d4eae648-de23-41c9-9075-c440a97b1843 req-32387256-bcc7-48ea-ba7d-5099a491c9f6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030903 May 10 21:29:27.735945 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 473/942] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:29:27.755055 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-c9a50168-cec3-4a28-b6ca-ad265b73f202 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:27.755776 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-c9a50168-cec3-4a28-b6ca-ad265b73f202 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: be10fb2e-2e0a-4c03-980c-c4dfcbb563f4] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:27.762996 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c9a50168-cec3-4a28-b6ca-ad265b73f202 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:27.763614 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c9a50168-cec3-4a28-b6ca-ad265b73f202 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:27.764443 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c9a50168-cec3-4a28-b6ca-ad265b73f202 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:27.764945 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c9a50168-cec3-4a28-b6ca-ad265b73f202 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:27.912870 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-c9a50168-cec3-4a28-b6ca-ad265b73f202 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f3a5742c42e6a1ddeb117df6f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea060bca7aa9440ba37d2093af6e9d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:27.920332 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-c9a50168-cec3-4a28-b6ca-ad265b73f202 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4" status: 200 len: 1313 microversion: 2.1 time: 0.170671 May 10 21:29:27.920900 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 470/943] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:27 2022] GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:27.969797 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-f0646bb8-4fd5-465a-9ee3-44c67fe9d39f tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:27.970452 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-f0646bb8-4fd5-465a-9ee3-44c67fe9d39f tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] [instance: 0664bc19-9eb0-4a77-82e1-9a359cae128d] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:27.976681 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f0646bb8-4fd5-465a-9ee3-44c67fe9d39f tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:27.977132 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f0646bb8-4fd5-465a-9ee3-44c67fe9d39f tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:27.977906 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f0646bb8-4fd5-465a-9ee3-44c67fe9d39f tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:27.978343 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f0646bb8-4fd5-465a-9ee3-44c67fe9d39f tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:28.003482 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-f0646bb8-4fd5-465a-9ee3-44c67fe9d39f tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] [instance: 0664bc19-9eb0-4a77-82e1-9a359cae128d] Going to try to terminate instance {{(pid=117678) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 21:29:28.262260 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-f0646bb8-4fd5-465a-9ee3-44c67fe9d39f tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0664bc19-9eb0-4a77-82e1-9a359cae128d" status: 204 len: 0 microversion: 2.1 time: 0.297157 May 10 21:29:28.262796 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 474/944] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 10 21:29:27 2022] DELETE /compute/v2.1/servers/0664bc19-9eb0-4a77-82e1-9a359cae128d => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 21:29:28.272527 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-2649de9d-f121-4623-b2d7-3260f54ab73c tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:28.273235 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-2649de9d-f121-4623-b2d7-3260f54ab73c tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] [instance: 0664bc19-9eb0-4a77-82e1-9a359cae128d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:28.279398 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2649de9d-f121-4623-b2d7-3260f54ab73c tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:28.279869 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2649de9d-f121-4623-b2d7-3260f54ab73c tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:28.280636 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2649de9d-f121-4623-b2d7-3260f54ab73c tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:28.281066 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2649de9d-f121-4623-b2d7-3260f54ab73c tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:28.409800 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2649de9d-f121-4623-b2d7-3260f54ab73c tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618beebad5b645c9a30632bd0677658e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95545f74981b44aeb69f246159088da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:28.417168 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-2649de9d-f121-4623-b2d7-3260f54ab73c tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] 10.222.0.25 "GET /compute/v2.1/servers/0664bc19-9eb0-4a77-82e1-9a359cae128d" status: 200 len: 1513 microversion: 2.1 time: 0.149348 May 10 21:29:28.417740 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 471/945] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:28 2022] GET /compute/v2.1/servers/0664bc19-9eb0-4a77-82e1-9a359cae128d => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:28.938910 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-b5899870-f54d-4ddc-890b-18d6096f6a36 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:28.939764 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-b5899870-f54d-4ddc-890b-18d6096f6a36 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: be10fb2e-2e0a-4c03-980c-c4dfcbb563f4] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:28.946061 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b5899870-f54d-4ddc-890b-18d6096f6a36 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:28.946536 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b5899870-f54d-4ddc-890b-18d6096f6a36 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:28.947287 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b5899870-f54d-4ddc-890b-18d6096f6a36 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:28.947712 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b5899870-f54d-4ddc-890b-18d6096f6a36 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:29.075508 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-b5899870-f54d-4ddc-890b-18d6096f6a36 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f3a5742c42e6a1ddeb117df6f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea060bca7aa9440ba37d2093af6e9d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:29.082726 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-b5899870-f54d-4ddc-890b-18d6096f6a36 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4" status: 200 len: 1313 microversion: 2.1 time: 0.148622 May 10 21:29:29.083292 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 475/946] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:28 2022] GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:29.433980 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e0120f34-89d9-4f12-98a4-0e49ee38db04 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:29.434622 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-e0120f34-89d9-4f12-98a4-0e49ee38db04 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] [instance: 0664bc19-9eb0-4a77-82e1-9a359cae128d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:29.441187 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e0120f34-89d9-4f12-98a4-0e49ee38db04 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:29.441632 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e0120f34-89d9-4f12-98a4-0e49ee38db04 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:29.442398 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e0120f34-89d9-4f12-98a4-0e49ee38db04 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:29.442852 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e0120f34-89d9-4f12-98a4-0e49ee38db04 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:29.570391 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-e0120f34-89d9-4f12-98a4-0e49ee38db04 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618beebad5b645c9a30632bd0677658e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95545f74981b44aeb69f246159088da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:29.578023 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-e0120f34-89d9-4f12-98a4-0e49ee38db04 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] 10.222.0.25 "GET /compute/v2.1/servers/0664bc19-9eb0-4a77-82e1-9a359cae128d" status: 200 len: 1513 microversion: 2.1 time: 0.147941 May 10 21:29:29.579293 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 472/947] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:29 2022] GET /compute/v2.1/servers/0664bc19-9eb0-4a77-82e1-9a359cae128d => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:30.099698 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-61c232c0-0e40-41e0-b7b8-3ed6c99ef0e0 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:30.100303 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-61c232c0-0e40-41e0-b7b8-3ed6c99ef0e0 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: be10fb2e-2e0a-4c03-980c-c4dfcbb563f4] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:30.106740 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-61c232c0-0e40-41e0-b7b8-3ed6c99ef0e0 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:30.107177 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-61c232c0-0e40-41e0-b7b8-3ed6c99ef0e0 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:30.107929 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-61c232c0-0e40-41e0-b7b8-3ed6c99ef0e0 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:30.108351 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-61c232c0-0e40-41e0-b7b8-3ed6c99ef0e0 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:30.241268 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-61c232c0-0e40-41e0-b7b8-3ed6c99ef0e0 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f3a5742c42e6a1ddeb117df6f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea060bca7aa9440ba37d2093af6e9d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:30.248692 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-61c232c0-0e40-41e0-b7b8-3ed6c99ef0e0 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4" status: 200 len: 1313 microversion: 2.1 time: 0.152806 May 10 21:29:30.249272 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 476/948] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:30 2022] GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:30.597068 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a2ed9903-a6b3-456b-ad08-75afea5044e9 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:30.598456 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-a2ed9903-a6b3-456b-ad08-75afea5044e9 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] [instance: 0664bc19-9eb0-4a77-82e1-9a359cae128d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:30.600840 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-be35ee81-130f-40ab-81ce-ce2cc6e995a0 req-e736b1ee-951c-4867-a193-9b3d9b77c2a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0664bc19-9eb0-4a77-82e1-9a359cae128d", "name": "network-vif-deleted", "tag": "165129bc-4fec-4b69-b151-5cf1bccfaefa"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:29:30.605150 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a2ed9903-a6b3-456b-ad08-75afea5044e9 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:30.605596 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a2ed9903-a6b3-456b-ad08-75afea5044e9 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:30.609462 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a2ed9903-a6b3-456b-ad08-75afea5044e9 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:30.609462 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a2ed9903-a6b3-456b-ad08-75afea5044e9 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:30.610396 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-be35ee81-130f-40ab-81ce-ce2cc6e995a0 req-e736b1ee-951c-4867-a193-9b3d9b77c2a6 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:30.610396 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-be35ee81-130f-40ab-81ce-ce2cc6e995a0 req-e736b1ee-951c-4867-a193-9b3d9b77c2a6 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:30.621087 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-be35ee81-130f-40ab-81ce-ce2cc6e995a0 req-e736b1ee-951c-4867-a193-9b3d9b77c2a6 service nova] Creating event network-vif-deleted:165129bc-4fec-4b69-b151-5cf1bccfaefa for instance 0664bc19-9eb0-4a77-82e1-9a359cae128d on hv-cinder-83608 May 10 21:29:30.626789 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-be35ee81-130f-40ab-81ce-ce2cc6e995a0 req-e736b1ee-951c-4867-a193-9b3d9b77c2a6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029223 May 10 21:29:30.627585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 477/949] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:29:30.672589 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-a2ed9903-a6b3-456b-ad08-75afea5044e9 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618beebad5b645c9a30632bd0677658e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95545f74981b44aeb69f246159088da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:30.680681 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-a2ed9903-a6b3-456b-ad08-75afea5044e9 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] 10.222.0.25 "GET /compute/v2.1/servers/0664bc19-9eb0-4a77-82e1-9a359cae128d" status: 200 len: 1471 microversion: 2.1 time: 0.088415 May 10 21:29:30.681258 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 473/950] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:30 2022] GET /compute/v2.1/servers/0664bc19-9eb0-4a77-82e1-9a359cae128d => generated 1471 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:31.267597 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-d51f6761-ecbd-4918-9f67-7df6a47e67d0 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:31.268417 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-d51f6761-ecbd-4918-9f67-7df6a47e67d0 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: be10fb2e-2e0a-4c03-980c-c4dfcbb563f4] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:31.274416 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d51f6761-ecbd-4918-9f67-7df6a47e67d0 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:31.274893 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d51f6761-ecbd-4918-9f67-7df6a47e67d0 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:31.275664 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d51f6761-ecbd-4918-9f67-7df6a47e67d0 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:31.276097 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d51f6761-ecbd-4918-9f67-7df6a47e67d0 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:31.408838 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-d51f6761-ecbd-4918-9f67-7df6a47e67d0 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f3a5742c42e6a1ddeb117df6f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea060bca7aa9440ba37d2093af6e9d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:31.416372 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-d51f6761-ecbd-4918-9f67-7df6a47e67d0 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4" status: 200 len: 1497 microversion: 2.1 time: 0.153771 May 10 21:29:31.416949 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 478/951] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:31 2022] GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4 => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:31.697599 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-ba54a8c6-f7d8-4269-a412-d136154c3500 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:31.698142 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-ba54a8c6-f7d8-4269-a412-d136154c3500 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] [instance: 0664bc19-9eb0-4a77-82e1-9a359cae128d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:31.708869 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ba54a8c6-f7d8-4269-a412-d136154c3500 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:31.708869 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ba54a8c6-f7d8-4269-a412-d136154c3500 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:31.708869 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ba54a8c6-f7d8-4269-a412-d136154c3500 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:31.708869 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ba54a8c6-f7d8-4269-a412-d136154c3500 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:31.721319 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-ba54a8c6-f7d8-4269-a412-d136154c3500 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] HTTP exception thrown: Instance 0664bc19-9eb0-4a77-82e1-9a359cae128d could not be found. May 10 21:29:31.723004 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-ba54a8c6-f7d8-4269-a412-d136154c3500 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Request method failure captured: May 10 21:29:31.723004 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: request: GET /compute/v2.1/servers/0664bc19-9eb0-4a77-82e1-9a359cae128d HTTP/1.1 May 10 21:29:31.723004 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept: application/json May 10 21:29:31.723004 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity May 10 21:29:31.723004 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Connection: close May 10 21:29:31.723004 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Length: 0 May 10 21:29:31.723004 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Type: application/json May 10 21:29:31.723004 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Host: 10.222.0.25 May 10 21:29:31.723004 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None May 10 21:29:31.723004 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 May 10 21:29:31.723004 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABietjMGLGvU0LzR9KjXfzPkEXCboMk1QcB0bCNZCt4NxzezZh2iUmpidYzU8xJ5G86wN87eVrhs9lHiEa1p9KlpPZl6-J0_iYQV8A8f0rm4LLH-0fjGLTIqacUN1yaKvamfGUY3dy3amwdqTJ3odG19Pso75eyGI1se7vtSozQXH3duuE May 10 21:29:31.723004 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Id: None May 10 21:29:31.723004 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Name: None May 10 21:29:31.723004 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed May 10 21:29:31.723004 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True May 10 21:29:31.723004 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default May 10 21:29:31.723004 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default May 10 21:29:31.723004 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Id: 95545f74981b44aeb69f246159088da1 May 10 21:29:31.723004 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1370820569 May 10 21:29:31.723004 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Role: member,reader May 10 21:29:31.723004 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Roles: member,reader May 10 21:29:31.724655 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/95545f74981b44aeb69f246159088da1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_95545f74981b44aeb69f246159088da1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/95545f74981b44aeb69f246159088da1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/95545f74981b44aeb69f246159088da1"}]}] May 10 21:29:31.724655 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-VolumesSnapshotTestJSON-1370820569 May 10 21:29:31.724655 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Id: 95545f74981b44aeb69f246159088da1 May 10 21:29:31.724655 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1370820569 May 10 21:29:31.724655 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User: tempest-VolumesSnapshotTestJSON-1370820569-project May 10 21:29:31.724655 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default May 10 21:29:31.724655 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default May 10 21:29:31.724655 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Id: 618beebad5b645c9a30632bd0677658e May 10 21:29:31.724655 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-VolumesSnapshotTestJSON-1370820569-project May 10 21:29:31.724655 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: method: > May 10 21:29:31.724655 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: exception: Instance 0664bc19-9eb0-4a77-82e1-9a359cae128d could not be found. May 10 21:29:31.724655 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: action_args: {'id': '0664bc19-9eb0-4a77-82e1-9a359cae128d'} May 10 21:29:31.728051 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:29:31.728051 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:29:31.728051 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:29:31.728051 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:29:31.728051 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:29:31.728051 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:29:31.728051 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:29:31.728051 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:29:31.728051 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:29:31.728051 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:29:31.728051 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0664bc19-9eb0-4a77-82e1-9a359cae128d could not be found. May 10 21:29:31.728051 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:29:31.728051 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:29:31.728051 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:29:31.728051 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:29:31.728051 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:29:31.728051 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:29:31.728051 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:29:31.728051 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:29:31.728051 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:29:31.729510 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:29:31.729510 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:29:31.729510 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:29:31.729510 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:29:31.729510 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:29:31.729510 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:29:31.729510 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:29:31.729510 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0664bc19-9eb0-4a77-82e1-9a359cae128d could not be found. May 10 21:29:31.729510 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:29:31.729510 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:29:31.729510 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:29:31.729510 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:29:31.729510 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:29:31.729510 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:29:31.729510 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:29:31.729510 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:29:31.729510 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0664bc19-9eb0-4a77-82e1-9a359cae128d could not be found. May 10 21:29:31.729510 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:29:31.730679 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-ba54a8c6-f7d8-4269-a412-d136154c3500 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] Returning 404 to user: Instance 0664bc19-9eb0-4a77-82e1-9a359cae128d could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:29:31.730679 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-ba54a8c6-f7d8-4269-a412-d136154c3500 tempest-VolumesSnapshotTestJSON-1370820569 tempest-VolumesSnapshotTestJSON-1370820569-project] 10.222.0.25 "GET /compute/v2.1/servers/0664bc19-9eb0-4a77-82e1-9a359cae128d" status: 404 len: 111 microversion: 2.1 time: 0.030831 May 10 21:29:31.730679 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 474/952] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:31 2022] GET /compute/v2.1/servers/0664bc19-9eb0-4a77-82e1-9a359cae128d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:29:32.099733 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-c8d95b55-8fc5-4c49-94a6-28c5c3c8ea1b tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:32.100220 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-c8d95b55-8fc5-4c49-94a6-28c5c3c8ea1b tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: be10fb2e-2e0a-4c03-980c-c4dfcbb563f4] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:32.106258 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c8d95b55-8fc5-4c49-94a6-28c5c3c8ea1b tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:32.106258 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c8d95b55-8fc5-4c49-94a6-28c5c3c8ea1b tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:32.107524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c8d95b55-8fc5-4c49-94a6-28c5c3c8ea1b tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:32.107951 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-c8d95b55-8fc5-4c49-94a6-28c5c3c8ea1b tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:32.132459 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-c8d95b55-8fc5-4c49-94a6-28c5c3c8ea1b tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: be10fb2e-2e0a-4c03-980c-c4dfcbb563f4] Going to try to terminate instance {{(pid=117678) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 21:29:32.462250 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-c8d95b55-8fc5-4c49-94a6-28c5c3c8ea1b tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "DELETE /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4" status: 204 len: 0 microversion: 2.1 time: 0.366241 May 10 21:29:32.462911 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 479/953] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 10 21:29:32 2022] DELETE /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 21:29:32.471294 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-3421dde5-16b6-4b54-a515-3c7a898fb8ef tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:32.471907 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-3421dde5-16b6-4b54-a515-3c7a898fb8ef tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: be10fb2e-2e0a-4c03-980c-c4dfcbb563f4] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:32.478001 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3421dde5-16b6-4b54-a515-3c7a898fb8ef tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:32.478465 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3421dde5-16b6-4b54-a515-3c7a898fb8ef tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:32.479245 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3421dde5-16b6-4b54-a515-3c7a898fb8ef tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:32.479684 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3421dde5-16b6-4b54-a515-3c7a898fb8ef tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:32.613481 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-3421dde5-16b6-4b54-a515-3c7a898fb8ef tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f3a5742c42e6a1ddeb117df6f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea060bca7aa9440ba37d2093af6e9d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:32.620867 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-3421dde5-16b6-4b54-a515-3c7a898fb8ef tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4" status: 200 len: 1503 microversion: 2.1 time: 0.153738 May 10 21:29:32.621429 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 475/954] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:32 2022] GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:33.639657 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-bb13ca23-7b94-42b6-9111-cf5333a45f4e tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:33.640346 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-bb13ca23-7b94-42b6-9111-cf5333a45f4e tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: be10fb2e-2e0a-4c03-980c-c4dfcbb563f4] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:33.646889 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-bb13ca23-7b94-42b6-9111-cf5333a45f4e tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:33.647330 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-bb13ca23-7b94-42b6-9111-cf5333a45f4e tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:33.648091 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-bb13ca23-7b94-42b6-9111-cf5333a45f4e tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:33.648560 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-bb13ca23-7b94-42b6-9111-cf5333a45f4e tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:33.798474 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-bb13ca23-7b94-42b6-9111-cf5333a45f4e tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f3a5742c42e6a1ddeb117df6f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea060bca7aa9440ba37d2093af6e9d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:33.803667 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-bb13ca23-7b94-42b6-9111-cf5333a45f4e tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4" status: 200 len: 1503 microversion: 2.1 time: 0.168472 May 10 21:29:33.804245 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 480/955] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:33 2022] GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4 => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:34.275816 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-1ce4a8f5-fa45-458c-b47b-bc4d804a6f0e req-b781b991-4a8d-4710-aaf1-12729d762ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be10fb2e-2e0a-4c03-980c-c4dfcbb563f4", "name": "network-vif-deleted", "tag": "4cee6493-96ab-49cc-acbd-c243ce44c492"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:29:34.284808 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-1ce4a8f5-fa45-458c-b47b-bc4d804a6f0e req-b781b991-4a8d-4710-aaf1-12729d762ae2 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:34.285720 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-1ce4a8f5-fa45-458c-b47b-bc4d804a6f0e req-b781b991-4a8d-4710-aaf1-12729d762ae2 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:34.296032 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-1ce4a8f5-fa45-458c-b47b-bc4d804a6f0e req-b781b991-4a8d-4710-aaf1-12729d762ae2 service nova] Creating event network-vif-deleted:4cee6493-96ab-49cc-acbd-c243ce44c492 for instance be10fb2e-2e0a-4c03-980c-c4dfcbb563f4 on hv-cinder-83608 May 10 21:29:34.301704 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-1ce4a8f5-fa45-458c-b47b-bc4d804a6f0e req-b781b991-4a8d-4710-aaf1-12729d762ae2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029585 May 10 21:29:34.302278 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 476/956] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:29:34.820813 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-194b1662-a7ae-4127-87b9-5446276c2182 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:34.821426 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-194b1662-a7ae-4127-87b9-5446276c2182 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: be10fb2e-2e0a-4c03-980c-c4dfcbb563f4] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:34.827805 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-194b1662-a7ae-4127-87b9-5446276c2182 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:34.828283 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-194b1662-a7ae-4127-87b9-5446276c2182 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:34.829556 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-194b1662-a7ae-4127-87b9-5446276c2182 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:34.830144 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-194b1662-a7ae-4127-87b9-5446276c2182 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:34.893159 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-194b1662-a7ae-4127-87b9-5446276c2182 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f3a5742c42e6a1ddeb117df6f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea060bca7aa9440ba37d2093af6e9d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:34.900436 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-194b1662-a7ae-4127-87b9-5446276c2182 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4" status: 200 len: 1461 microversion: 2.1 time: 0.083476 May 10 21:29:34.901009 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 481/957] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:34 2022] GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4 => generated 1461 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:35.918251 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-c577429e-32eb-40d0-be66-426f7b92dfa8 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:35.918967 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-c577429e-32eb-40d0-be66-426f7b92dfa8 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: be10fb2e-2e0a-4c03-980c-c4dfcbb563f4] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:35.926146 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c577429e-32eb-40d0-be66-426f7b92dfa8 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:35.926618 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c577429e-32eb-40d0-be66-426f7b92dfa8 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:35.927366 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c577429e-32eb-40d0-be66-426f7b92dfa8 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:35.927791 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c577429e-32eb-40d0-be66-426f7b92dfa8 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:35.989751 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-c577429e-32eb-40d0-be66-426f7b92dfa8 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f3a5742c42e6a1ddeb117df6f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea060bca7aa9440ba37d2093af6e9d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:35.997055 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-c577429e-32eb-40d0-be66-426f7b92dfa8 tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4" status: 200 len: 1298 microversion: 2.1 time: 0.082941 May 10 21:29:35.997609 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 477/958] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:35 2022] GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4 => generated 1298 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:37.013530 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-38fc9bcd-353d-4793-80f0-9766c44984da tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:37.014059 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-38fc9bcd-353d-4793-80f0-9766c44984da tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: be10fb2e-2e0a-4c03-980c-c4dfcbb563f4] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:37.021220 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-38fc9bcd-353d-4793-80f0-9766c44984da tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:37.023410 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-38fc9bcd-353d-4793-80f0-9766c44984da tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:37.023410 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-38fc9bcd-353d-4793-80f0-9766c44984da tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:37.023410 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-38fc9bcd-353d-4793-80f0-9766c44984da tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:37.055422 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-38fc9bcd-353d-4793-80f0-9766c44984da tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:37.055863 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-38fc9bcd-353d-4793-80f0-9766c44984da tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:37.056307 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.objects.instance [None req-38fc9bcd-353d-4793-80f0-9766c44984da tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lazy-loading 'fault' on Instance uuid be10fb2e-2e0a-4c03-980c-c4dfcbb563f4 {{(pid=117678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:29:37.098131 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-38fc9bcd-353d-4793-80f0-9766c44984da tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f3a5742c42e6a1ddeb117df6f01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea060bca7aa9440ba37d2093af6e9d16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:37.105313 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-38fc9bcd-353d-4793-80f0-9766c44984da tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4" status: 200 len: 1303 microversion: 2.1 time: 0.096006 May 10 21:29:37.105879 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 482/959] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:37 2022] GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4 => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:38.123500 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-9439d8d8-5264-4565-bb04-18d27c8711df tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:38.124113 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-9439d8d8-5264-4565-bb04-18d27c8711df tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] [instance: be10fb2e-2e0a-4c03-980c-c4dfcbb563f4] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:38.131046 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9439d8d8-5264-4565-bb04-18d27c8711df tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:38.131488 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9439d8d8-5264-4565-bb04-18d27c8711df tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:38.132242 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9439d8d8-5264-4565-bb04-18d27c8711df tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:38.132668 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9439d8d8-5264-4565-bb04-18d27c8711df tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:38.148195 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-9439d8d8-5264-4565-bb04-18d27c8711df tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] HTTP exception thrown: Instance be10fb2e-2e0a-4c03-980c-c4dfcbb563f4 could not be found. May 10 21:29:38.149793 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-9439d8d8-5264-4565-bb04-18d27c8711df tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Request method failure captured: May 10 21:29:38.149793 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: request: GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4 HTTP/1.1 May 10 21:29:38.149793 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept: application/json May 10 21:29:38.149793 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity May 10 21:29:38.149793 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Connection: close May 10 21:29:38.149793 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Length: 0 May 10 21:29:38.149793 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Type: application/json May 10 21:29:38.149793 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Host: 10.222.0.25 May 10 21:29:38.149793 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None May 10 21:29:38.149793 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 May 10 21:29:38.149793 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABietkPa7ZCRSWSKMKTS7tFL25xPBpfEoGaNERlGRTq7Llk0-FyLRGktSlx6tKYK13Zis-CE1z5Ynss_R1rABKFbYFHLU61mJU8o-t6uiSZywe6ikN_RvaKJVoK471SntnovR3LDrMH7dhppuAiQReTSxsVynIPbqRBjSil-W13avpE7CI May 10 21:29:38.149793 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Id: None May 10 21:29:38.149793 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Name: None May 10 21:29:38.149793 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed May 10 21:29:38.149793 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True May 10 21:29:38.149793 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default May 10 21:29:38.149793 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default May 10 21:29:38.149793 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Id: ea060bca7aa9440ba37d2093af6e9d16 May 10 21:29:38.149793 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-VolumesActionsTest-1443750451 May 10 21:29:38.149793 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Role: member,reader May 10 21:29:38.149793 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Roles: member,reader May 10 21:29:38.151445 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ea060bca7aa9440ba37d2093af6e9d16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ea060bca7aa9440ba37d2093af6e9d16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ea060bca7aa9440ba37d2093af6e9d16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ea060bca7aa9440ba37d2093af6e9d16"}]}] May 10 21:29:38.151445 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-VolumesActionsTest-1443750451 May 10 21:29:38.151445 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Id: ea060bca7aa9440ba37d2093af6e9d16 May 10 21:29:38.151445 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-VolumesActionsTest-1443750451 May 10 21:29:38.151445 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User: tempest-VolumesActionsTest-1443750451-project May 10 21:29:38.151445 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default May 10 21:29:38.151445 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default May 10 21:29:38.151445 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Id: ca75f3a5742c42e6a1ddeb117df6f01e May 10 21:29:38.151445 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-VolumesActionsTest-1443750451-project May 10 21:29:38.151445 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: method: > May 10 21:29:38.151445 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: exception: Instance be10fb2e-2e0a-4c03-980c-c4dfcbb563f4 could not be found. May 10 21:29:38.151445 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: action_args: {'id': 'be10fb2e-2e0a-4c03-980c-c4dfcbb563f4'} May 10 21:29:38.152400 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:29:38.152400 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:29:38.152400 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:29:38.152400 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:29:38.152400 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:29:38.152400 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:29:38.152400 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:29:38.152400 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:29:38.152400 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:29:38.152400 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:29:38.152400 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be10fb2e-2e0a-4c03-980c-c4dfcbb563f4 could not be found. May 10 21:29:38.152400 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:29:38.152400 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:29:38.152400 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:29:38.152400 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:29:38.152400 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:29:38.152400 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:29:38.152400 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:29:38.152400 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:29:38.152400 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:29:38.153889 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:29:38.153889 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:29:38.153889 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:29:38.153889 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:29:38.153889 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:29:38.153889 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:29:38.153889 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:29:38.153889 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be10fb2e-2e0a-4c03-980c-c4dfcbb563f4 could not be found. May 10 21:29:38.153889 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:29:38.153889 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:29:38.153889 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:29:38.153889 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:29:38.153889 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:29:38.153889 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:29:38.153889 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:29:38.153889 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:29:38.153889 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be10fb2e-2e0a-4c03-980c-c4dfcbb563f4 could not be found. May 10 21:29:38.153889 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:29:38.155203 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-9439d8d8-5264-4565-bb04-18d27c8711df tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] Returning 404 to user: Instance be10fb2e-2e0a-4c03-980c-c4dfcbb563f4 could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:29:38.155203 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-9439d8d8-5264-4565-bb04-18d27c8711df tempest-VolumesActionsTest-1443750451 tempest-VolumesActionsTest-1443750451-project] 10.222.0.25 "GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4" status: 404 len: 111 microversion: 2.1 time: 0.031557 May 10 21:29:38.155203 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 478/960] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:29:38 2022] GET /compute/v2.1/servers/be10fb2e-2e0a-4c03-980c-c4dfcbb563f4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:30:14.467334 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-b5847388-04a1-473b-8fb0-5b1623fcc8f9 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Action: 'create', calling method: .version_select at 0x7f7aea2d5a60>, body: {"keypair": {"name": "tempest-TestShelveInstance-1344486950", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3mNwOJtyIztvObT/rUMoLJevxa5Jf+SPypeEZ43BifTdJWGjaCjRJjjIEx2lgokFAEja9r8ddUC6Mdl+HP1W+4LCRSgUpMyfSeAkiPZJRRmTt7NYoFGGQioJpK4eocIw=="}} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:30:14.487411 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.quota [None req-b5847388-04a1-473b-8fb0-5b1623fcc8f9 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Getting quotas for project 419939c78a2449e6a958b430e0e14d04. Resources: {'key_pairs'} {{(pid=117678) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:30:14.491530 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.quota [None req-b5847388-04a1-473b-8fb0-5b1623fcc8f9 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Getting quotas for user efdf21c4f62e44cca32de43efd532418 and project 419939c78a2449e6a958b430e0e14d04. Resources: {'key_pairs'} {{(pid=117678) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:30:14.578192 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-b5847388-04a1-473b-8fb0-5b1623fcc8f9 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.363368 May 10 21:30:14.585351 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 483/961] 10.222.0.25 () {60 vars in 1158 bytes} [Tue May 10 21:30:14 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:30:29.732191 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-be9ff28f-c18d-48c5-be05-a59607709caa tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Action: 'create', calling method: .version_select at 0x7f7aea3e83a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-548372847", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEa/uOr5hVWOQP7J/NGsqI7BFIBWkq4ImIeNtCjgLXDNcLlNjTuN3I++zXUidmw1qKF90B5Nen/YeDV/ZkgR4ghPb+jL+0IYcoCFGZLfaxM7xGTXOhIlnUXpdyDy6ROfdA=="}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:30:29.754070 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-be9ff28f-c18d-48c5-be05-a59607709caa tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Getting quotas for project dd6f673d1cfd41028e5ed60d4d204666. Resources: {'key_pairs'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:30:29.758098 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-be9ff28f-c18d-48c5-be05-a59607709caa tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Getting quotas for user 6802e5cde5bb48e2958124c88a7501d9 and project dd6f673d1cfd41028e5ed60d4d204666. Resources: {'key_pairs'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:30:29.893787 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-be9ff28f-c18d-48c5-be05-a59607709caa tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.328682 May 10 21:30:29.894703 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 479/962] 10.222.0.25 () {60 vars in 1158 bytes} [Tue May 10 21:30:29 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:30:33.074793 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-d7196f2e-b5c8-47d1-88bf-035208dbe382 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-914082588", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1344486950", "security_groups": [{"name": "tempest-secgroup-smoke-716660761"}], "networks": [{"uuid": "484536f2-a5f5-49e6-840b-c926af035216"}], "block_device_mapping_v2": [{"uuid": "cbe8dd1c-8b54-47bd-a70b-a89fec214fcd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:30:33.557751 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.network.neutron [None req-d7196f2e-b5c8-47d1-88bf-035208dbe382 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] validate_networks() for [('484536f2-a5f5-49e6-840b-c926af035216', None, None, None, None, None)] {{(pid=117678) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 21:30:34.022878 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-d7196f2e-b5c8-47d1-88bf-035208dbe382 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Flavor limits 0:0:0 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 21:30:34.023436 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-d7196f2e-b5c8-47d1-88bf-035208dbe382 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Image limits 0:0:0 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 21:30:34.024317 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-d7196f2e-b5c8-47d1-88bf-035208dbe382 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Flavor pref 0:0:0 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 21:30:34.024736 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-d7196f2e-b5c8-47d1-88bf-035208dbe382 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Image pref 0:0:0 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 21:30:34.025204 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-d7196f2e-b5c8-47d1-88bf-035208dbe382 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 21:30:34.038170 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d7196f2e-b5c8-47d1-88bf-035208dbe382 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:34.038721 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d7196f2e-b5c8-47d1-88bf-035208dbe382 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:34.039764 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d7196f2e-b5c8-47d1-88bf-035208dbe382 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:34.041271 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d7196f2e-b5c8-47d1-88bf-035208dbe382 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:34.069742 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.quota [None req-d7196f2e-b5c8-47d1-88bf-035208dbe382 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Getting quotas for project 419939c78a2449e6a958b430e0e14d04. Resources: {'cores', 'instances', 'ram'} {{(pid=117678) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:30:34.075533 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.quota [None req-d7196f2e-b5c8-47d1-88bf-035208dbe382 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Getting quotas for user efdf21c4f62e44cca32de43efd532418 and project 419939c78a2449e6a958b430e0e14d04. Resources: {'cores', 'instances', 'ram'} {{(pid=117678) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:30:34.158386 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-d7196f2e-b5c8-47d1-88bf-035208dbe382 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Going to run 1 instances... {{(pid=117678) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 21:30:34.161503 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-d7196f2e-b5c8-47d1-88bf-035208dbe382 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cbe8dd1c-8b54-47bd-a70b-a89fec214fcd',volume_size=None,volume_type=None)] {{(pid=117678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 21:30:34.626564 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-d7196f2e-b5c8-47d1-88bf-035208dbe382 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.555745 May 10 21:30:34.629480 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 484/963] 10.222.0.25 () {60 vars in 1146 bytes} [Tue May 10 21:30:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 1559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 21:30:34.641168 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-91c8cfea-2938-48b1-a0c7-8b30435f172f tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:34.644385 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-91c8cfea-2938-48b1-a0c7-8b30435f172f tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:34.836486 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-91c8cfea-2938-48b1-a0c7-8b30435f172f tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:34.845261 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-91c8cfea-2938-48b1-a0c7-8b30435f172f tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1088 microversion: 2.1 time: 0.210956 May 10 21:30:34.846057 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 480/964] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:30:34 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1088 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:35.863422 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-3148c7fc-066e-48c8-bfde-0d4a874d2d77 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:35.864123 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-3148c7fc-066e-48c8-bfde-0d4a874d2d77 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:35.872419 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3148c7fc-066e-48c8-bfde-0d4a874d2d77 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:35.873218 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3148c7fc-066e-48c8-bfde-0d4a874d2d77 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:35.874259 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3148c7fc-066e-48c8-bfde-0d4a874d2d77 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:35.875363 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3148c7fc-066e-48c8-bfde-0d4a874d2d77 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:35.948672 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-3148c7fc-066e-48c8-bfde-0d4a874d2d77 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:35.957077 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-3148c7fc-066e-48c8-bfde-0d4a874d2d77 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1138 microversion: 2.1 time: 0.097814 May 10 21:30:35.957661 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 485/965] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:30:35 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1138 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:36.976116 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a9f2eef0-f691-4707-8abb-327ba44fb364 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:36.976762 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-a9f2eef0-f691-4707-8abb-327ba44fb364 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:36.984313 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a9f2eef0-f691-4707-8abb-327ba44fb364 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:36.984786 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a9f2eef0-f691-4707-8abb-327ba44fb364 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:36.985636 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a9f2eef0-f691-4707-8abb-327ba44fb364 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:36.986068 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a9f2eef0-f691-4707-8abb-327ba44fb364 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:37.064091 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-a9f2eef0-f691-4707-8abb-327ba44fb364 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:37.078432 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-a9f2eef0-f691-4707-8abb-327ba44fb364 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1194 microversion: 2.1 time: 0.102699 May 10 21:30:37.078432 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 481/966] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:30:36 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1194 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:30:38.092738 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-31fd9baa-4b81-4847-9801-c6299c0abff7 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:38.093358 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-31fd9baa-4b81-4847-9801-c6299c0abff7 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:38.101569 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-31fd9baa-4b81-4847-9801-c6299c0abff7 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:38.102025 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-31fd9baa-4b81-4847-9801-c6299c0abff7 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:38.102833 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-31fd9baa-4b81-4847-9801-c6299c0abff7 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:38.103443 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-31fd9baa-4b81-4847-9801-c6299c0abff7 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:38.284738 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-31fd9baa-4b81-4847-9801-c6299c0abff7 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:38.292932 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-31fd9baa-4b81-4847-9801-c6299c0abff7 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1271 microversion: 2.1 time: 0.204293 May 10 21:30:38.293949 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 486/967] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:30:38 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1271 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:38.909573 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-7e2357fb-68b6-4e52-bf6e-13648fc3c189 req-fb46b95d-faab-42e4-91ab-64567fa6762a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84148312-3a13-4e3f-b60a-a70b63d71910", "tag": "4d7713f5-cbd0-420c-8d5e-b66a3e380a1d"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:30:38.918299 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-7e2357fb-68b6-4e52-bf6e-13648fc3c189 req-fb46b95d-faab-42e4-91ab-64567fa6762a service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:38.918804 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-7e2357fb-68b6-4e52-bf6e-13648fc3c189 req-fb46b95d-faab-42e4-91ab-64567fa6762a service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:38.931277 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-7e2357fb-68b6-4e52-bf6e-13648fc3c189 req-fb46b95d-faab-42e4-91ab-64567fa6762a service nova] Creating event network-changed:4d7713f5-cbd0-420c-8d5e-b66a3e380a1d for instance 84148312-3a13-4e3f-b60a-a70b63d71910 on hv-cinder-83608 May 10 21:30:38.940870 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-7e2357fb-68b6-4e52-bf6e-13648fc3c189 req-fb46b95d-faab-42e4-91ab-64567fa6762a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037504 May 10 21:30:38.942323 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 482/968] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:30:39.311147 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-ed8ca550-5b8a-4f54-8ad3-b75d34a27c1d tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:39.311809 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-ed8ca550-5b8a-4f54-8ad3-b75d34a27c1d tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:39.319306 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ed8ca550-5b8a-4f54-8ad3-b75d34a27c1d tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:39.321201 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ed8ca550-5b8a-4f54-8ad3-b75d34a27c1d tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:39.322880 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ed8ca550-5b8a-4f54-8ad3-b75d34a27c1d tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:39.324469 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ed8ca550-5b8a-4f54-8ad3-b75d34a27c1d tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:39.487002 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-ed8ca550-5b8a-4f54-8ad3-b75d34a27c1d tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:39.494259 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-ed8ca550-5b8a-4f54-8ad3-b75d34a27c1d tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1259 microversion: 2.1 time: 0.187420 May 10 21:30:39.494859 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 487/969] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:30:39 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1259 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:40.512695 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-92f025f8-d175-454a-a330-bb65d5942e68 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:40.513384 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-92f025f8-d175-454a-a330-bb65d5942e68 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:40.519790 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-92f025f8-d175-454a-a330-bb65d5942e68 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:40.520230 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-92f025f8-d175-454a-a330-bb65d5942e68 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:40.520980 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-92f025f8-d175-454a-a330-bb65d5942e68 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:40.521407 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-92f025f8-d175-454a-a330-bb65d5942e68 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:40.657697 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-92f025f8-d175-454a-a330-bb65d5942e68 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:40.667713 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-92f025f8-d175-454a-a330-bb65d5942e68 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1259 microversion: 2.1 time: 0.159614 May 10 21:30:40.668716 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 483/970] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:30:40 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:41.685225 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-d6dd2549-e922-4d40-9617-d3cf25c96093 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:41.685820 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-d6dd2549-e922-4d40-9617-d3cf25c96093 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:41.693648 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d6dd2549-e922-4d40-9617-d3cf25c96093 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:41.694095 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d6dd2549-e922-4d40-9617-d3cf25c96093 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:41.694909 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d6dd2549-e922-4d40-9617-d3cf25c96093 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:41.695342 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-d6dd2549-e922-4d40-9617-d3cf25c96093 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:41.844384 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-d6dd2549-e922-4d40-9617-d3cf25c96093 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:41.852888 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-d6dd2549-e922-4d40-9617-d3cf25c96093 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1259 microversion: 2.1 time: 0.171496 May 10 21:30:41.853671 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 488/971] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:30:41 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:42.869662 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-db64e1e7-7e9d-4c69-9b88-e335b77d5145 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:42.870271 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-db64e1e7-7e9d-4c69-9b88-e335b77d5145 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:42.876574 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-db64e1e7-7e9d-4c69-9b88-e335b77d5145 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:42.877023 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-db64e1e7-7e9d-4c69-9b88-e335b77d5145 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:42.878619 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-db64e1e7-7e9d-4c69-9b88-e335b77d5145 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:42.879042 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-db64e1e7-7e9d-4c69-9b88-e335b77d5145 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:43.010407 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-db64e1e7-7e9d-4c69-9b88-e335b77d5145 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:43.017726 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-db64e1e7-7e9d-4c69-9b88-e335b77d5145 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1259 microversion: 2.1 time: 0.151877 May 10 21:30:43.018355 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 484/972] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:30:42 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:44.034201 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-7907dc03-f984-442a-bce4-8e6f5e9e8b23 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:44.035629 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-7907dc03-f984-442a-bce4-8e6f5e9e8b23 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:44.042060 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7907dc03-f984-442a-bce4-8e6f5e9e8b23 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:44.042535 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7907dc03-f984-442a-bce4-8e6f5e9e8b23 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:44.043295 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7907dc03-f984-442a-bce4-8e6f5e9e8b23 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:44.043725 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-7907dc03-f984-442a-bce4-8e6f5e9e8b23 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:44.169321 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-7907dc03-f984-442a-bce4-8e6f5e9e8b23 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:44.177359 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-7907dc03-f984-442a-bce4-8e6f5e9e8b23 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1259 microversion: 2.1 time: 0.146958 May 10 21:30:44.177931 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 489/973] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:30:44 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1259 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:45.193644 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-b815b815-13cd-4995-98f2-dea30127ea81 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:45.194286 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-b815b815-13cd-4995-98f2-dea30127ea81 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:45.200579 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b815b815-13cd-4995-98f2-dea30127ea81 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:45.201022 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b815b815-13cd-4995-98f2-dea30127ea81 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:45.201777 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b815b815-13cd-4995-98f2-dea30127ea81 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:45.202208 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b815b815-13cd-4995-98f2-dea30127ea81 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:45.331373 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b815b815-13cd-4995-98f2-dea30127ea81 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:45.339449 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-b815b815-13cd-4995-98f2-dea30127ea81 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1259 microversion: 2.1 time: 0.149902 May 10 21:30:45.340008 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 485/974] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:30:45 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:46.356198 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-ed027268-1988-44e0-a89b-7ebbba5c919b tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:46.356738 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-ed027268-1988-44e0-a89b-7ebbba5c919b tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:46.363127 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ed027268-1988-44e0-a89b-7ebbba5c919b tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:46.363571 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ed027268-1988-44e0-a89b-7ebbba5c919b tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:46.364329 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ed027268-1988-44e0-a89b-7ebbba5c919b tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:46.364763 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-ed027268-1988-44e0-a89b-7ebbba5c919b tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:46.502198 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-ed027268-1988-44e0-a89b-7ebbba5c919b tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:46.505338 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-ed027268-1988-44e0-a89b-7ebbba5c919b tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1259 microversion: 2.1 time: 0.153081 May 10 21:30:46.506103 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 490/975] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:30:46 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:47.523534 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e76b3ffe-ba69-4755-a096-86b20ebb7289 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:47.524142 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-e76b3ffe-ba69-4755-a096-86b20ebb7289 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:47.530785 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e76b3ffe-ba69-4755-a096-86b20ebb7289 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:47.531235 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e76b3ffe-ba69-4755-a096-86b20ebb7289 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:47.532034 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e76b3ffe-ba69-4755-a096-86b20ebb7289 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:47.532473 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e76b3ffe-ba69-4755-a096-86b20ebb7289 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:47.666059 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-e76b3ffe-ba69-4755-a096-86b20ebb7289 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:47.673642 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-e76b3ffe-ba69-4755-a096-86b20ebb7289 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1259 microversion: 2.1 time: 0.155322 May 10 21:30:47.674213 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 486/976] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:30:47 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:48.309260 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-03ff2c4a-aafe-420c-8d03-1cd688815d68 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1562644783", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-548372847", "security_groups": [{"name": "tempest-secgroup-smoke-855147982"}], "block_device_mapping_v2": [{"uuid": "4f68d6ad-4c57-4f2a-a8a5-f27dfa62fee0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "48d591e9-fc52-4c70-9c70-8d7c37800f78"}]}} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:30:48.421103 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.network.neutron [None req-03ff2c4a-aafe-420c-8d03-1cd688815d68 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] validate_networks() for [('48d591e9-fc52-4c70-9c70-8d7c37800f78', None, None, None, None, None)] {{(pid=117678) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 21:30:48.690452 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-b2cf1c5c-2136-4ca8-bf93-073c2d324667 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:48.691243 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-b2cf1c5c-2136-4ca8-bf93-073c2d324667 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:48.697425 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b2cf1c5c-2136-4ca8-bf93-073c2d324667 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:48.697871 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b2cf1c5c-2136-4ca8-bf93-073c2d324667 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:48.698692 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b2cf1c5c-2136-4ca8-bf93-073c2d324667 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:48.699128 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b2cf1c5c-2136-4ca8-bf93-073c2d324667 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:48.832637 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b2cf1c5c-2136-4ca8-bf93-073c2d324667 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:48.834164 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-03ff2c4a-aafe-420c-8d03-1cd688815d68 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Flavor limits 0:0:0 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 21:30:48.834637 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-03ff2c4a-aafe-420c-8d03-1cd688815d68 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Image limits 0:0:0 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 21:30:48.835113 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-03ff2c4a-aafe-420c-8d03-1cd688815d68 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Flavor pref 0:0:0 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 21:30:48.835522 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-03ff2c4a-aafe-420c-8d03-1cd688815d68 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Image pref 0:0:0 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 21:30:48.835931 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-03ff2c4a-aafe-420c-8d03-1cd688815d68 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 21:30:48.840514 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-b2cf1c5c-2136-4ca8-bf93-073c2d324667 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1259 microversion: 2.1 time: 0.153944 May 10 21:30:48.850372 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 487/977] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:30:48 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:30:48.852048 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-03ff2c4a-aafe-420c-8d03-1cd688815d68 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:48.852516 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-03ff2c4a-aafe-420c-8d03-1cd688815d68 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:48.853281 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-03ff2c4a-aafe-420c-8d03-1cd688815d68 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:48.853709 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-03ff2c4a-aafe-420c-8d03-1cd688815d68 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:48.870129 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.quota [None req-03ff2c4a-aafe-420c-8d03-1cd688815d68 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Getting quotas for project dd6f673d1cfd41028e5ed60d4d204666. Resources: {'cores', 'instances', 'ram'} {{(pid=117678) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:30:48.873801 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.quota [None req-03ff2c4a-aafe-420c-8d03-1cd688815d68 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Getting quotas for user 6802e5cde5bb48e2958124c88a7501d9 and project dd6f673d1cfd41028e5ed60d4d204666. Resources: {'cores', 'instances', 'ram'} {{(pid=117678) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:30:48.930154 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-03ff2c4a-aafe-420c-8d03-1cd688815d68 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Going to run 1 instances... {{(pid=117678) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 21:30:48.932261 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-03ff2c4a-aafe-420c-8d03-1cd688815d68 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: d9e4cb99-8342-478c-962e-8b22f512072d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4f68d6ad-4c57-4f2a-a8a5-f27dfa62fee0',volume_size=None,volume_type=None)] {{(pid=117678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 21:30:49.085915 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-7bd99f21-1e60-4f5f-a610-ea636552bcc7 req-14dec3cf-0072-4bd3-80a8-57732cfb9999 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84148312-3a13-4e3f-b60a-a70b63d71910", "name": "network-vif-plugged", "status": "completed", "tag": "4d7713f5-cbd0-420c-8d5e-b66a3e380a1d"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:30:49.093895 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-7bd99f21-1e60-4f5f-a610-ea636552bcc7 req-14dec3cf-0072-4bd3-80a8-57732cfb9999 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:49.094369 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-7bd99f21-1e60-4f5f-a610-ea636552bcc7 req-14dec3cf-0072-4bd3-80a8-57732cfb9999 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:49.105438 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-7bd99f21-1e60-4f5f-a610-ea636552bcc7 req-14dec3cf-0072-4bd3-80a8-57732cfb9999 service nova] Creating event network-vif-plugged:4d7713f5-cbd0-420c-8d5e-b66a3e380a1d for instance 84148312-3a13-4e3f-b60a-a70b63d71910 on hv-cinder-83608 May 10 21:30:49.110628 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-7bd99f21-1e60-4f5f-a610-ea636552bcc7 req-14dec3cf-0072-4bd3-80a8-57732cfb9999 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029517 May 10 21:30:49.111467 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 488/978] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:30:49.280246 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-03ff2c4a-aafe-420c-8d03-1cd688815d68 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.974985 May 10 21:30:49.280916 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 491/979] 10.222.0.25 () {60 vars in 1146 bytes} [Tue May 10 21:30:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 21:30:49.291397 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-fe25effb-5646-48dc-802c-dba6aa40efd9 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:49.292097 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-fe25effb-5646-48dc-802c-dba6aa40efd9 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: d9e4cb99-8342-478c-962e-8b22f512072d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:49.346942 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-fe25effb-5646-48dc-802c-dba6aa40efd9 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:49.353668 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-fe25effb-5646-48dc-802c-dba6aa40efd9 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d" status: 200 len: 1094 microversion: 2.1 time: 0.066390 May 10 21:30:49.354276 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 489/980] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:30:49 2022] GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:49.857623 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-003f8e59-433a-4514-85d3-5df4f03dacab tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:49.860258 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-003f8e59-433a-4514-85d3-5df4f03dacab tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:49.865861 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-003f8e59-433a-4514-85d3-5df4f03dacab tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:49.866309 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-003f8e59-433a-4514-85d3-5df4f03dacab tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:49.867156 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-003f8e59-433a-4514-85d3-5df4f03dacab tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:49.867594 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-003f8e59-433a-4514-85d3-5df4f03dacab tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:49.996291 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-003f8e59-433a-4514-85d3-5df4f03dacab tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:50.004206 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-003f8e59-433a-4514-85d3-5df4f03dacab tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1259 microversion: 2.1 time: 0.150491 May 10 21:30:50.007522 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 492/981] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:30:49 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:50.370584 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e2514419-6041-4dbc-b33a-115b8841034f tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:50.371268 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-e2514419-6041-4dbc-b33a-115b8841034f tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: d9e4cb99-8342-478c-962e-8b22f512072d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:50.379097 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e2514419-6041-4dbc-b33a-115b8841034f tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:50.379689 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e2514419-6041-4dbc-b33a-115b8841034f tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:50.380415 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e2514419-6041-4dbc-b33a-115b8841034f tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:50.380850 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e2514419-6041-4dbc-b33a-115b8841034f tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:50.445904 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-e2514419-6041-4dbc-b33a-115b8841034f tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:50.454281 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-e2514419-6041-4dbc-b33a-115b8841034f tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d" status: 200 len: 1144 microversion: 2.1 time: 0.087539 May 10 21:30:50.455098 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 490/982] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:30:50 2022] GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:51.021812 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-f42118df-895b-48a0-936b-449af9f1e81d tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:51.022427 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-f42118df-895b-48a0-936b-449af9f1e81d tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:51.028852 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f42118df-895b-48a0-936b-449af9f1e81d tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:51.029297 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f42118df-895b-48a0-936b-449af9f1e81d tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:51.030069 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f42118df-895b-48a0-936b-449af9f1e81d tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:51.030532 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f42118df-895b-48a0-936b-449af9f1e81d tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:51.162839 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-f42118df-895b-48a0-936b-449af9f1e81d tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:51.170278 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-f42118df-895b-48a0-936b-449af9f1e81d tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1442 microversion: 2.1 time: 0.153027 May 10 21:30:51.170878 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 493/983] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:30:51 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1442 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:51.187363 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-f24ee481-ef2c-41bc-a022-529666f0fb1c tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:51.187966 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-f24ee481-ef2c-41bc-a022-529666f0fb1c tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:51.194074 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f24ee481-ef2c-41bc-a022-529666f0fb1c tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:51.194573 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f24ee481-ef2c-41bc-a022-529666f0fb1c tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:51.195294 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f24ee481-ef2c-41bc-a022-529666f0fb1c tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:51.195721 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f24ee481-ef2c-41bc-a022-529666f0fb1c tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:51.327071 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-f24ee481-ef2c-41bc-a022-529666f0fb1c tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:51.336067 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-f24ee481-ef2c-41bc-a022-529666f0fb1c tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1442 microversion: 2.1 time: 0.152800 May 10 21:30:51.336640 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 491/984] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:30:51 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1442 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:51.470805 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-97c7e361-ca23-4de1-986b-3e5be6722428 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:51.471609 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-97c7e361-ca23-4de1-986b-3e5be6722428 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: d9e4cb99-8342-478c-962e-8b22f512072d] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:51.477853 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-97c7e361-ca23-4de1-986b-3e5be6722428 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:51.478294 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-97c7e361-ca23-4de1-986b-3e5be6722428 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:51.479093 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-97c7e361-ca23-4de1-986b-3e5be6722428 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:51.479515 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-97c7e361-ca23-4de1-986b-3e5be6722428 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:51.546093 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-97c7e361-ca23-4de1-986b-3e5be6722428 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:51.553536 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-97c7e361-ca23-4de1-986b-3e5be6722428 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d" status: 200 len: 1200 microversion: 2.1 time: 0.086711 May 10 21:30:51.554114 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 494/985] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:30:51 2022] GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d => generated 1200 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:52.577259 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-57b8cbab-d3b8-4d2e-9766-51366405418a tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:52.577962 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-57b8cbab-d3b8-4d2e-9766-51366405418a tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: d9e4cb99-8342-478c-962e-8b22f512072d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:52.585293 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-57b8cbab-d3b8-4d2e-9766-51366405418a tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:52.585987 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-57b8cbab-d3b8-4d2e-9766-51366405418a tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:52.586810 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-57b8cbab-d3b8-4d2e-9766-51366405418a tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:52.587400 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-57b8cbab-d3b8-4d2e-9766-51366405418a tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:52.833564 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-57b8cbab-d3b8-4d2e-9766-51366405418a tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:52.846901 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-57b8cbab-d3b8-4d2e-9766-51366405418a tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d" status: 200 len: 1277 microversion: 2.1 time: 0.280129 May 10 21:30:52.847695 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 492/986] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:30:52 2022] GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d => generated 1277 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:53.380144 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-f2032740-5d19-476f-a6e4-320fbdcf4ceb req-ccde752c-a379-40d3-b084-246bbdf01658 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9e4cb99-8342-478c-962e-8b22f512072d", "tag": "3e945f63-8c31-4674-aeb5-a32565e47756"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:30:53.392537 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-f2032740-5d19-476f-a6e4-320fbdcf4ceb req-ccde752c-a379-40d3-b084-246bbdf01658 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:53.392985 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-f2032740-5d19-476f-a6e4-320fbdcf4ceb req-ccde752c-a379-40d3-b084-246bbdf01658 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:53.407501 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-f2032740-5d19-476f-a6e4-320fbdcf4ceb req-ccde752c-a379-40d3-b084-246bbdf01658 service nova] Creating event network-changed:3e945f63-8c31-4674-aeb5-a32565e47756 for instance d9e4cb99-8342-478c-962e-8b22f512072d on hv-cinder-83608 May 10 21:30:53.420760 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-f2032740-5d19-476f-a6e4-320fbdcf4ceb req-ccde752c-a379-40d3-b084-246bbdf01658 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042213 May 10 21:30:53.421965 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 495/987] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:30:53.599937 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-5d7c46d5-71ae-4db4-8bb9-1e87c22b845a req-f68b8c95-ebe4-42c4-881c-bd9d82ada93a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84148312-3a13-4e3f-b60a-a70b63d71910", "tag": "4d7713f5-cbd0-420c-8d5e-b66a3e380a1d"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:30:53.609822 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-5d7c46d5-71ae-4db4-8bb9-1e87c22b845a req-f68b8c95-ebe4-42c4-881c-bd9d82ada93a service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:53.611443 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-5d7c46d5-71ae-4db4-8bb9-1e87c22b845a req-f68b8c95-ebe4-42c4-881c-bd9d82ada93a service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:53.626718 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-5d7c46d5-71ae-4db4-8bb9-1e87c22b845a req-f68b8c95-ebe4-42c4-881c-bd9d82ada93a service nova] Creating event network-changed:4d7713f5-cbd0-420c-8d5e-b66a3e380a1d for instance 84148312-3a13-4e3f-b60a-a70b63d71910 on hv-cinder-83608 May 10 21:30:53.631921 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-5d7c46d5-71ae-4db4-8bb9-1e87c22b845a req-f68b8c95-ebe4-42c4-881c-bd9d82ada93a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103761 May 10 21:30:53.633087 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 493/988] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:30:53.866066 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-0e2731f2-5fa4-46f5-91fb-5f144be8219a tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:53.866803 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-0e2731f2-5fa4-46f5-91fb-5f144be8219a tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: d9e4cb99-8342-478c-962e-8b22f512072d] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:53.873548 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0e2731f2-5fa4-46f5-91fb-5f144be8219a tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:53.874322 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0e2731f2-5fa4-46f5-91fb-5f144be8219a tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:53.875139 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0e2731f2-5fa4-46f5-91fb-5f144be8219a tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:53.875750 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0e2731f2-5fa4-46f5-91fb-5f144be8219a tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:54.021947 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-0e2731f2-5fa4-46f5-91fb-5f144be8219a tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:54.030708 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-0e2731f2-5fa4-46f5-91fb-5f144be8219a tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d" status: 200 len: 1265 microversion: 2.1 time: 0.169676 May 10 21:30:54.031782 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 496/989] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:30:53 2022] GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:55.050303 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-2f7f27ac-0004-4fea-ad66-29ca48502f36 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:55.051525 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-2f7f27ac-0004-4fea-ad66-29ca48502f36 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: d9e4cb99-8342-478c-962e-8b22f512072d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:55.057673 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2f7f27ac-0004-4fea-ad66-29ca48502f36 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:55.058112 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2f7f27ac-0004-4fea-ad66-29ca48502f36 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:55.058943 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2f7f27ac-0004-4fea-ad66-29ca48502f36 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:55.059366 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2f7f27ac-0004-4fea-ad66-29ca48502f36 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:55.199863 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2f7f27ac-0004-4fea-ad66-29ca48502f36 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:55.207256 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-2f7f27ac-0004-4fea-ad66-29ca48502f36 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d" status: 200 len: 1265 microversion: 2.1 time: 0.161718 May 10 21:30:55.207829 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 494/990] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:30:55 2022] GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:56.223966 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-6f2e87be-1772-407a-893d-1e1e00a230b2 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:56.224577 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-6f2e87be-1772-407a-893d-1e1e00a230b2 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: d9e4cb99-8342-478c-962e-8b22f512072d] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:56.230982 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6f2e87be-1772-407a-893d-1e1e00a230b2 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:56.231421 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6f2e87be-1772-407a-893d-1e1e00a230b2 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:56.232173 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6f2e87be-1772-407a-893d-1e1e00a230b2 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:56.232600 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6f2e87be-1772-407a-893d-1e1e00a230b2 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:56.362107 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-6f2e87be-1772-407a-893d-1e1e00a230b2 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:56.370230 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-6f2e87be-1772-407a-893d-1e1e00a230b2 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d" status: 200 len: 1265 microversion: 2.1 time: 0.150133 May 10 21:30:56.370845 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 497/991] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:30:56 2022] GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:57.386978 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-314d64ac-01b4-4bdd-af01-cb79cb69c4dc tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:57.387580 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-314d64ac-01b4-4bdd-af01-cb79cb69c4dc tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: d9e4cb99-8342-478c-962e-8b22f512072d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:57.394583 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-314d64ac-01b4-4bdd-af01-cb79cb69c4dc tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:57.395034 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-314d64ac-01b4-4bdd-af01-cb79cb69c4dc tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:57.395817 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-314d64ac-01b4-4bdd-af01-cb79cb69c4dc tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:57.396244 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-314d64ac-01b4-4bdd-af01-cb79cb69c4dc tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:57.525308 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-314d64ac-01b4-4bdd-af01-cb79cb69c4dc tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:57.532675 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-314d64ac-01b4-4bdd-af01-cb79cb69c4dc tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d" status: 200 len: 1265 microversion: 2.1 time: 0.149890 May 10 21:30:57.533240 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 495/992] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:30:57 2022] GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:58.549588 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-130cfa2a-744e-451c-8a89-92cb922d527f tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:58.550748 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-130cfa2a-744e-451c-8a89-92cb922d527f tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: d9e4cb99-8342-478c-962e-8b22f512072d] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:58.557110 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-130cfa2a-744e-451c-8a89-92cb922d527f tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:58.557551 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-130cfa2a-744e-451c-8a89-92cb922d527f tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:58.558301 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-130cfa2a-744e-451c-8a89-92cb922d527f tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:58.558762 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-130cfa2a-744e-451c-8a89-92cb922d527f tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:58.684402 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-130cfa2a-744e-451c-8a89-92cb922d527f tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:58.692523 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-130cfa2a-744e-451c-8a89-92cb922d527f tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d" status: 200 len: 1265 microversion: 2.1 time: 0.146774 May 10 21:30:58.693100 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 498/993] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:30:58 2022] GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:59.709435 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4c15d0ce-81a3-4309-ae2f-766ed9089d2c tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:59.710039 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-4c15d0ce-81a3-4309-ae2f-766ed9089d2c tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: d9e4cb99-8342-478c-962e-8b22f512072d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:59.716389 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4c15d0ce-81a3-4309-ae2f-766ed9089d2c tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:59.716827 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4c15d0ce-81a3-4309-ae2f-766ed9089d2c tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:59.717583 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4c15d0ce-81a3-4309-ae2f-766ed9089d2c tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:59.718009 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4c15d0ce-81a3-4309-ae2f-766ed9089d2c tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:59.851508 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-4c15d0ce-81a3-4309-ae2f-766ed9089d2c tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:59.858810 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4c15d0ce-81a3-4309-ae2f-766ed9089d2c tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d" status: 200 len: 1265 microversion: 2.1 time: 0.153278 May 10 21:30:59.859366 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 496/994] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:30:59 2022] GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:31:00.875268 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-acda619f-0bf8-43b1-bb3d-faedaa3fbc93 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:00.875885 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-acda619f-0bf8-43b1-bb3d-faedaa3fbc93 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: d9e4cb99-8342-478c-962e-8b22f512072d] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:00.882661 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-acda619f-0bf8-43b1-bb3d-faedaa3fbc93 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:00.883112 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-acda619f-0bf8-43b1-bb3d-faedaa3fbc93 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:00.884150 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-acda619f-0bf8-43b1-bb3d-faedaa3fbc93 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:00.884580 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-acda619f-0bf8-43b1-bb3d-faedaa3fbc93 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:01.016784 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-acda619f-0bf8-43b1-bb3d-faedaa3fbc93 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:01.024949 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-acda619f-0bf8-43b1-bb3d-faedaa3fbc93 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d" status: 200 len: 1265 microversion: 2.1 time: 0.153516 May 10 21:31:01.025528 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 499/995] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:31:00 2022] GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:31:02.041805 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-3ceff004-58f6-4bb7-8e96-0411987c035c tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:02.042419 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-3ceff004-58f6-4bb7-8e96-0411987c035c tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: d9e4cb99-8342-478c-962e-8b22f512072d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:02.048339 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3ceff004-58f6-4bb7-8e96-0411987c035c tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:02.048786 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3ceff004-58f6-4bb7-8e96-0411987c035c tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:02.054023 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3ceff004-58f6-4bb7-8e96-0411987c035c tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:02.054023 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3ceff004-58f6-4bb7-8e96-0411987c035c tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:02.178531 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-3ceff004-58f6-4bb7-8e96-0411987c035c tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:02.185922 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-3ceff004-58f6-4bb7-8e96-0411987c035c tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d" status: 200 len: 1265 microversion: 2.1 time: 0.148229 May 10 21:31:02.186511 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 497/996] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:31:02 2022] GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:31:03.125063 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-a880c18f-7a78-4c42-918a-af2be0b52aaa req-c2dd97a0-17b9-4ce9-b833-96df78d7a0a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9e4cb99-8342-478c-962e-8b22f512072d", "name": "network-vif-plugged", "status": "completed", "tag": "3e945f63-8c31-4674-aeb5-a32565e47756"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:31:03.133486 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-a880c18f-7a78-4c42-918a-af2be0b52aaa req-c2dd97a0-17b9-4ce9-b833-96df78d7a0a6 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:03.134193 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-a880c18f-7a78-4c42-918a-af2be0b52aaa req-c2dd97a0-17b9-4ce9-b833-96df78d7a0a6 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:03.145701 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-a880c18f-7a78-4c42-918a-af2be0b52aaa req-c2dd97a0-17b9-4ce9-b833-96df78d7a0a6 service nova] Creating event network-vif-plugged:3e945f63-8c31-4674-aeb5-a32565e47756 for instance d9e4cb99-8342-478c-962e-8b22f512072d on hv-cinder-83608 May 10 21:31:03.150805 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-a880c18f-7a78-4c42-918a-af2be0b52aaa req-c2dd97a0-17b9-4ce9-b833-96df78d7a0a6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087588 May 10 21:31:03.151425 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 500/997] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:31:03.203447 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-3bf62cac-518c-4939-871d-d4ce065b1ade tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:03.204051 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-3bf62cac-518c-4939-871d-d4ce065b1ade tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: d9e4cb99-8342-478c-962e-8b22f512072d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:03.212267 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3bf62cac-518c-4939-871d-d4ce065b1ade tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:03.212715 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3bf62cac-518c-4939-871d-d4ce065b1ade tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:03.213485 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3bf62cac-518c-4939-871d-d4ce065b1ade tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:03.213920 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3bf62cac-518c-4939-871d-d4ce065b1ade tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:03.345228 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-3bf62cac-518c-4939-871d-d4ce065b1ade tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:03.353143 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-3bf62cac-518c-4939-871d-d4ce065b1ade tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d" status: 200 len: 1265 microversion: 2.1 time: 0.153512 May 10 21:31:03.353726 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 498/998] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:31:03 2022] GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:31:04.370824 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-84574079-cbdd-40eb-8727-52587ad45a34 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:04.371526 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-84574079-cbdd-40eb-8727-52587ad45a34 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: d9e4cb99-8342-478c-962e-8b22f512072d] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:04.377820 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-84574079-cbdd-40eb-8727-52587ad45a34 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:04.378863 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-84574079-cbdd-40eb-8727-52587ad45a34 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:04.379842 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-84574079-cbdd-40eb-8727-52587ad45a34 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:04.380278 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-84574079-cbdd-40eb-8727-52587ad45a34 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:04.508294 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-84574079-cbdd-40eb-8727-52587ad45a34 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:04.515785 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-84574079-cbdd-40eb-8727-52587ad45a34 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d" status: 200 len: 1265 microversion: 2.1 time: 0.149674 May 10 21:31:04.516353 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 501/999] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:31:04 2022] GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:31:05.532602 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-bbfd4878-0e59-4e29-902e-dd6d5fc3da71 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:05.533233 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-bbfd4878-0e59-4e29-902e-dd6d5fc3da71 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: d9e4cb99-8342-478c-962e-8b22f512072d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:05.540331 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bbfd4878-0e59-4e29-902e-dd6d5fc3da71 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:05.540776 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bbfd4878-0e59-4e29-902e-dd6d5fc3da71 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:05.541523 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bbfd4878-0e59-4e29-902e-dd6d5fc3da71 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:05.541953 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bbfd4878-0e59-4e29-902e-dd6d5fc3da71 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:05.669167 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-bbfd4878-0e59-4e29-902e-dd6d5fc3da71 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:05.676793 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-bbfd4878-0e59-4e29-902e-dd6d5fc3da71 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d" status: 200 len: 1452 microversion: 2.1 time: 0.148077 May 10 21:31:05.677356 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 499/1000] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:31:05 2022] GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d => generated 1452 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:31:05.693531 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-a608e4be-5f02-437a-912a-de95c3855bcb tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:05.694142 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-a608e4be-5f02-437a-912a-de95c3855bcb tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: d9e4cb99-8342-478c-962e-8b22f512072d] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:05.700485 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-a608e4be-5f02-437a-912a-de95c3855bcb tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:05.700929 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-a608e4be-5f02-437a-912a-de95c3855bcb tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:05.701694 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-a608e4be-5f02-437a-912a-de95c3855bcb tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:05.702129 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-a608e4be-5f02-437a-912a-de95c3855bcb tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:05.841736 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-a608e4be-5f02-437a-912a-de95c3855bcb tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:05.849639 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-a608e4be-5f02-437a-912a-de95c3855bcb tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d" status: 200 len: 1452 microversion: 2.1 time: 0.160941 May 10 21:31:05.850210 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 502/1001] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:31:05 2022] GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:31:08.074457 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-d4c25cdc-a419-4ec9-8967-f3ad30bb1867 req-43d3bbc8-7c03-4aad-b63d-6c0af2de4c2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9e4cb99-8342-478c-962e-8b22f512072d", "tag": "3e945f63-8c31-4674-aeb5-a32565e47756"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:31:08.082860 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-d4c25cdc-a419-4ec9-8967-f3ad30bb1867 req-43d3bbc8-7c03-4aad-b63d-6c0af2de4c2f service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:08.083340 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-d4c25cdc-a419-4ec9-8967-f3ad30bb1867 req-43d3bbc8-7c03-4aad-b63d-6c0af2de4c2f service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:08.094317 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-d4c25cdc-a419-4ec9-8967-f3ad30bb1867 req-43d3bbc8-7c03-4aad-b63d-6c0af2de4c2f service nova] Creating event network-changed:3e945f63-8c31-4674-aeb5-a32565e47756 for instance d9e4cb99-8342-478c-962e-8b22f512072d on hv-cinder-83608 May 10 21:31:08.099859 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-d4c25cdc-a419-4ec9-8967-f3ad30bb1867 req-43d3bbc8-7c03-4aad-b63d-6c0af2de4c2f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029344 May 10 21:31:08.100643 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 500/1002] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:31:55.724549 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 21:31:55.725259 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Tue May 10 21:31:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 21:32:51.042508 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-b48e43af-d09a-49eb-ae6e-2933a7b026af tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:32:51.055961 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-b48e43af-d09a-49eb-ae6e-2933a7b026af tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:51.055961 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b48e43af-d09a-49eb-ae6e-2933a7b026af tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:51.055961 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b48e43af-d09a-49eb-ae6e-2933a7b026af tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:51.055961 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b48e43af-d09a-49eb-ae6e-2933a7b026af tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:51.056369 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-b48e43af-d09a-49eb-ae6e-2933a7b026af tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:51.073433 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.objects.instance [None req-b48e43af-d09a-49eb-ae6e-2933a7b026af tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lazy-loading 'flavor' on Instance uuid 84148312-3a13-4e3f-b60a-a70b63d71910 {{(pid=117678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:32:51.398070 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-b48e43af-d09a-49eb-ae6e-2933a7b026af tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "POST /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910/action" status: 202 len: 0 microversion: 2.1 time: 0.360228 May 10 21:32:51.398744 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 503/1003] 10.222.0.25 () {60 vars in 1277 bytes} [Tue May 10 21:32:51 2022] POST /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 21:32:51.409234 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-7e6d2b0e-bdcd-4111-ac00-308c359d9820 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:51.409940 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-7e6d2b0e-bdcd-4111-ac00-308c359d9820 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:51.416114 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7e6d2b0e-bdcd-4111-ac00-308c359d9820 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:51.416565 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7e6d2b0e-bdcd-4111-ac00-308c359d9820 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:51.417336 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7e6d2b0e-bdcd-4111-ac00-308c359d9820 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:51.417802 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7e6d2b0e-bdcd-4111-ac00-308c359d9820 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:51.548049 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-7e6d2b0e-bdcd-4111-ac00-308c359d9820 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:51.555418 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-7e6d2b0e-bdcd-4111-ac00-308c359d9820 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1566 microversion: 2.1 time: 0.152218 May 10 21:32:51.555990 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 501/1004] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:32:51 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:32:52.574127 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-aa170860-3211-4c2c-8baf-272fa746f3e5 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:52.574836 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-aa170860-3211-4c2c-8baf-272fa746f3e5 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:52.581481 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-aa170860-3211-4c2c-8baf-272fa746f3e5 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:52.581937 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-aa170860-3211-4c2c-8baf-272fa746f3e5 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:52.582748 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-aa170860-3211-4c2c-8baf-272fa746f3e5 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:52.583181 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-aa170860-3211-4c2c-8baf-272fa746f3e5 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:52.715046 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-aa170860-3211-4c2c-8baf-272fa746f3e5 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:52.722920 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-aa170860-3211-4c2c-8baf-272fa746f3e5 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1566 microversion: 2.1 time: 0.153601 May 10 21:32:52.723491 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 504/1005] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:32:52 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:32:53.740370 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-98836be0-1419-4a61-adb6-30a50d154451 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:53.741013 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-98836be0-1419-4a61-adb6-30a50d154451 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:53.747470 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-98836be0-1419-4a61-adb6-30a50d154451 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:53.747915 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-98836be0-1419-4a61-adb6-30a50d154451 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:53.748834 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-98836be0-1419-4a61-adb6-30a50d154451 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:53.749467 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-98836be0-1419-4a61-adb6-30a50d154451 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:53.881277 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-98836be0-1419-4a61-adb6-30a50d154451 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:53.888867 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-98836be0-1419-4a61-adb6-30a50d154451 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1566 microversion: 2.1 time: 0.152413 May 10 21:32:53.889516 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 502/1006] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:32:53 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:32:54.905339 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-1116fbb1-42a5-4469-a132-f179400d0595 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:54.905964 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-1116fbb1-42a5-4469-a132-f179400d0595 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:54.912408 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1116fbb1-42a5-4469-a132-f179400d0595 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:54.912859 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1116fbb1-42a5-4469-a132-f179400d0595 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:54.913616 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1116fbb1-42a5-4469-a132-f179400d0595 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:54.914049 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1116fbb1-42a5-4469-a132-f179400d0595 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:55.042599 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-1116fbb1-42a5-4469-a132-f179400d0595 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:55.050072 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-1116fbb1-42a5-4469-a132-f179400d0595 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1566 microversion: 2.1 time: 0.149189 May 10 21:32:55.054461 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 505/1007] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:32:54 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:32:56.067183 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-b35dedb0-c891-4faf-a1ad-e2d5f509b507 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:56.067803 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-b35dedb0-c891-4faf-a1ad-e2d5f509b507 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:56.074118 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b35dedb0-c891-4faf-a1ad-e2d5f509b507 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:56.074600 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b35dedb0-c891-4faf-a1ad-e2d5f509b507 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:56.075376 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b35dedb0-c891-4faf-a1ad-e2d5f509b507 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:56.075811 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b35dedb0-c891-4faf-a1ad-e2d5f509b507 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:56.205247 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b35dedb0-c891-4faf-a1ad-e2d5f509b507 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:56.212569 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-b35dedb0-c891-4faf-a1ad-e2d5f509b507 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1566 microversion: 2.1 time: 0.149294 May 10 21:32:56.213129 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 503/1008] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:32:56 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:32:57.230596 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-596d6436-7d2e-4d60-a207-118f8f7c6ba0 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:57.231203 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-596d6436-7d2e-4d60-a207-118f8f7c6ba0 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:57.237681 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-596d6436-7d2e-4d60-a207-118f8f7c6ba0 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:57.238120 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-596d6436-7d2e-4d60-a207-118f8f7c6ba0 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:57.238907 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-596d6436-7d2e-4d60-a207-118f8f7c6ba0 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:57.239329 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-596d6436-7d2e-4d60-a207-118f8f7c6ba0 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:57.365325 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-596d6436-7d2e-4d60-a207-118f8f7c6ba0 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:57.372670 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-596d6436-7d2e-4d60-a207-118f8f7c6ba0 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1566 microversion: 2.1 time: 0.145978 May 10 21:32:57.373229 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 506/1009] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:32:57 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1566 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:32:58.390800 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-b440089f-0e5f-4f15-a8f4-edd3ac833f7e tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:58.391406 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-b440089f-0e5f-4f15-a8f4-edd3ac833f7e tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:58.397615 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b440089f-0e5f-4f15-a8f4-edd3ac833f7e tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:58.398055 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b440089f-0e5f-4f15-a8f4-edd3ac833f7e tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:58.398844 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b440089f-0e5f-4f15-a8f4-edd3ac833f7e tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:58.399270 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b440089f-0e5f-4f15-a8f4-edd3ac833f7e tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:58.526336 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b440089f-0e5f-4f15-a8f4-edd3ac833f7e tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:58.534000 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-b440089f-0e5f-4f15-a8f4-edd3ac833f7e tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1566 microversion: 2.1 time: 0.147627 May 10 21:32:58.534599 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 504/1010] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:32:58 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:32:59.551434 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-606c6098-2791-4b02-aa20-81f08c13c3b1 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:59.552028 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-606c6098-2791-4b02-aa20-81f08c13c3b1 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:59.558352 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-606c6098-2791-4b02-aa20-81f08c13c3b1 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:59.558823 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-606c6098-2791-4b02-aa20-81f08c13c3b1 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:59.559576 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-606c6098-2791-4b02-aa20-81f08c13c3b1 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:59.560004 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-606c6098-2791-4b02-aa20-81f08c13c3b1 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:59.689365 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-606c6098-2791-4b02-aa20-81f08c13c3b1 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:59.697091 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-606c6098-2791-4b02-aa20-81f08c13c3b1 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1566 microversion: 2.1 time: 0.149296 May 10 21:32:59.698360 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 507/1011] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:32:59 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:33:00.714204 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-1a9e524b-d0b3-4c2a-952f-3e07526556f1 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:00.714986 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-1a9e524b-d0b3-4c2a-952f-3e07526556f1 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:00.721481 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1a9e524b-d0b3-4c2a-952f-3e07526556f1 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:00.721929 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1a9e524b-d0b3-4c2a-952f-3e07526556f1 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:00.722759 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1a9e524b-d0b3-4c2a-952f-3e07526556f1 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:00.723198 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1a9e524b-d0b3-4c2a-952f-3e07526556f1 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:00.855317 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1a9e524b-d0b3-4c2a-952f-3e07526556f1 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:00.862939 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-1a9e524b-d0b3-4c2a-952f-3e07526556f1 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1566 microversion: 2.1 time: 0.152803 May 10 21:33:00.863505 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 505/1012] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:00 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:33:01.880354 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-9a1a1172-b568-40c2-91ef-256e30d4ede5 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:01.881060 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-9a1a1172-b568-40c2-91ef-256e30d4ede5 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:01.887667 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9a1a1172-b568-40c2-91ef-256e30d4ede5 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:01.888227 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9a1a1172-b568-40c2-91ef-256e30d4ede5 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:01.889043 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9a1a1172-b568-40c2-91ef-256e30d4ede5 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:01.889679 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9a1a1172-b568-40c2-91ef-256e30d4ede5 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:02.019593 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-9a1a1172-b568-40c2-91ef-256e30d4ede5 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:02.026944 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-9a1a1172-b568-40c2-91ef-256e30d4ede5 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1566 microversion: 2.1 time: 0.150450 May 10 21:33:02.027522 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 508/1013] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:01 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:33:03.044293 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a8e27c2c-ab2a-43e1-8662-428545e4fc8e tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:03.044900 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-a8e27c2c-ab2a-43e1-8662-428545e4fc8e tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:03.051814 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a8e27c2c-ab2a-43e1-8662-428545e4fc8e tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:03.052253 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a8e27c2c-ab2a-43e1-8662-428545e4fc8e tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:03.053003 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a8e27c2c-ab2a-43e1-8662-428545e4fc8e tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:03.053426 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a8e27c2c-ab2a-43e1-8662-428545e4fc8e tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:03.180272 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-a8e27c2c-ab2a-43e1-8662-428545e4fc8e tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:03.187728 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-a8e27c2c-ab2a-43e1-8662-428545e4fc8e tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1566 microversion: 2.1 time: 0.147315 May 10 21:33:03.188291 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 506/1014] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:03 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1566 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:33:04.204057 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-f9a9bb59-447a-462f-b49f-e8aa858fde02 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:04.204668 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-f9a9bb59-447a-462f-b49f-e8aa858fde02 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:04.211069 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f9a9bb59-447a-462f-b49f-e8aa858fde02 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:04.211520 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f9a9bb59-447a-462f-b49f-e8aa858fde02 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:04.212291 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f9a9bb59-447a-462f-b49f-e8aa858fde02 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:04.212727 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f9a9bb59-447a-462f-b49f-e8aa858fde02 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:04.343555 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-f9a9bb59-447a-462f-b49f-e8aa858fde02 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:04.351201 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-f9a9bb59-447a-462f-b49f-e8aa858fde02 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1566 microversion: 2.1 time: 0.151032 May 10 21:33:04.351854 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 509/1015] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:04 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:33:05.165160 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-8a63e5ee-b46a-4951-b9de-041be42b8bfb tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:05.165711 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-8a63e5ee-b46a-4951-b9de-041be42b8bfb tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: d9e4cb99-8342-478c-962e-8b22f512072d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:05.172058 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8a63e5ee-b46a-4951-b9de-041be42b8bfb tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:05.172499 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8a63e5ee-b46a-4951-b9de-041be42b8bfb tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:05.173259 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8a63e5ee-b46a-4951-b9de-041be42b8bfb tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:05.173679 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8a63e5ee-b46a-4951-b9de-041be42b8bfb tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:05.198195 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-8a63e5ee-b46a-4951-b9de-041be42b8bfb tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: d9e4cb99-8342-478c-962e-8b22f512072d] Going to try to terminate instance {{(pid=117679) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 21:33:05.368284 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-6fa27c44-44b6-4d22-bf2e-1b5e1f85c2fc tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:05.368878 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-6fa27c44-44b6-4d22-bf2e-1b5e1f85c2fc tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:05.375883 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6fa27c44-44b6-4d22-bf2e-1b5e1f85c2fc tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:05.376318 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6fa27c44-44b6-4d22-bf2e-1b5e1f85c2fc tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:05.377067 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6fa27c44-44b6-4d22-bf2e-1b5e1f85c2fc tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:05.377490 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6fa27c44-44b6-4d22-bf2e-1b5e1f85c2fc tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:05.497440 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-8a63e5ee-b46a-4951-b9de-041be42b8bfb tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d" status: 204 len: 0 microversion: 2.1 time: 0.335848 May 10 21:33:05.498026 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 507/1016] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 10 21:33:05 2022] DELETE /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 21:33:05.507190 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e428d938-6969-4544-8024-aa2d28f92e39 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:05.507874 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-e428d938-6969-4544-8024-aa2d28f92e39 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: d9e4cb99-8342-478c-962e-8b22f512072d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:05.513594 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-6fa27c44-44b6-4d22-bf2e-1b5e1f85c2fc tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:05.518632 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e428d938-6969-4544-8024-aa2d28f92e39 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:05.518632 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e428d938-6969-4544-8024-aa2d28f92e39 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:05.518632 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e428d938-6969-4544-8024-aa2d28f92e39 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:05.518632 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e428d938-6969-4544-8024-aa2d28f92e39 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:05.522357 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-6fa27c44-44b6-4d22-bf2e-1b5e1f85c2fc tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1507 microversion: 2.1 time: 0.157847 May 10 21:33:05.522982 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 510/1017] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:05 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:05.593730 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-3641e2fd-9bc9-4996-94ac-d22a943e2ec0 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:33:05.594292 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-3641e2fd-9bc9-4996-94ac-d22a943e2ec0 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:05.600120 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3641e2fd-9bc9-4996-94ac-d22a943e2ec0 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:05.600561 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3641e2fd-9bc9-4996-94ac-d22a943e2ec0 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:05.601345 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3641e2fd-9bc9-4996-94ac-d22a943e2ec0 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:05.601770 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3641e2fd-9bc9-4996-94ac-d22a943e2ec0 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:05.663806 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-e428d938-6969-4544-8024-aa2d28f92e39 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:05.672028 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-e428d938-6969-4544-8024-aa2d28f92e39 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d" status: 200 len: 1577 microversion: 2.1 time: 0.169051 May 10 21:33:05.673403 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 508/1018] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:05 2022] GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:05.676920 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-e802645c-ceaf-45fc-b0ec-6482ee42788d req-8320cf8e-6d73-45e7-a10e-59f045429160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84148312-3a13-4e3f-b60a-a70b63d71910", "name": "network-vif-unplugged", "status": "completed", "tag": "4d7713f5-cbd0-420c-8d5e-b66a3e380a1d"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:33:05.684621 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-e802645c-ceaf-45fc-b0ec-6482ee42788d req-8320cf8e-6d73-45e7-a10e-59f045429160 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:05.685056 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-e802645c-ceaf-45fc-b0ec-6482ee42788d req-8320cf8e-6d73-45e7-a10e-59f045429160 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:05.695856 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.compute.server_external_events [req-e802645c-ceaf-45fc-b0ec-6482ee42788d req-8320cf8e-6d73-45e7-a10e-59f045429160 service nova] Unable to find a host for instance 84148312-3a13-4e3f-b60a-a70b63d71910. Dropping event network-vif-unplugged {{(pid=117679) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 10 21:33:05.699286 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-e802645c-ceaf-45fc-b0ec-6482ee42788d req-8320cf8e-6d73-45e7-a10e-59f045429160 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.023218 May 10 21:33:05.699286 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 509/1019] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 24 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 10 21:33:05.864357 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3641e2fd-9bc9-4996-94ac-d22a943e2ec0 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [5090135e-793b-4cc5-ac33-213c04a71e5c] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 10 21:33:06.689657 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6f953551-5269-4ff4-a3a5-fb00bcb98017 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:06.690263 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-6f953551-5269-4ff4-a3a5-fb00bcb98017 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: d9e4cb99-8342-478c-962e-8b22f512072d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:06.696611 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6f953551-5269-4ff4-a3a5-fb00bcb98017 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:06.697048 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6f953551-5269-4ff4-a3a5-fb00bcb98017 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:06.697800 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6f953551-5269-4ff4-a3a5-fb00bcb98017 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:06.698238 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6f953551-5269-4ff4-a3a5-fb00bcb98017 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:06.828761 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-6f953551-5269-4ff4-a3a5-fb00bcb98017 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:06.836142 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-6f953551-5269-4ff4-a3a5-fb00bcb98017 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d" status: 200 len: 1577 microversion: 2.1 time: 0.150915 May 10 21:33:06.836712 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 510/1020] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:06 2022] GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:06.871487 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO oslo.messaging._drivers.impl_rabbit [None req-3641e2fd-9bc9-4996-94ac-d22a943e2ec0 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [5090135e-793b-4cc5-ac33-213c04a71e5c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 56976. May 10 21:33:06.875651 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-3641e2fd-9bc9-4996-94ac-d22a943e2ec0 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "POST /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910/action" status: 202 len: 0 microversion: 2.1 time: 1.286074 May 10 21:33:06.876264 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 511/1021] 10.222.0.25 () {60 vars in 1277 bytes} [Tue May 10 21:33:05 2022] POST /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910/action => generated 0 bytes in 1287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 21:33:06.884409 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-13cdceaf-c263-41a8-a6e9-4dff165feec6 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:06.885017 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-13cdceaf-c263-41a8-a6e9-4dff165feec6 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:06.890970 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-13cdceaf-c263-41a8-a6e9-4dff165feec6 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:06.891454 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-13cdceaf-c263-41a8-a6e9-4dff165feec6 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:06.892220 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-13cdceaf-c263-41a8-a6e9-4dff165feec6 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:06.892656 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-13cdceaf-c263-41a8-a6e9-4dff165feec6 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:07.109470 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-13cdceaf-c263-41a8-a6e9-4dff165feec6 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:07.117334 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-13cdceaf-c263-41a8-a6e9-4dff165feec6 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1515 microversion: 2.1 time: 0.236908 May 10 21:33:07.117976 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 511/1022] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:06 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1515 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:33:07.858404 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-0de56c6d-8ff7-4c23-9614-b72dfef0d33b tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:07.859241 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-0de56c6d-8ff7-4c23-9614-b72dfef0d33b tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: d9e4cb99-8342-478c-962e-8b22f512072d] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:07.866595 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0de56c6d-8ff7-4c23-9614-b72dfef0d33b tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:07.867141 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0de56c6d-8ff7-4c23-9614-b72dfef0d33b tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:07.867987 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0de56c6d-8ff7-4c23-9614-b72dfef0d33b tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:07.868621 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0de56c6d-8ff7-4c23-9614-b72dfef0d33b tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:07.941592 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-0de56c6d-8ff7-4c23-9614-b72dfef0d33b tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:07.953139 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-0de56c6d-8ff7-4c23-9614-b72dfef0d33b tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d" status: 200 len: 1510 microversion: 2.1 time: 0.103820 May 10 21:33:07.953880 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 512/1023] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:07 2022] GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d => generated 1510 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:33:08.135687 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-d11d5c86-49d2-4fee-a7d7-0c2761c084fa tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:08.136308 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-d11d5c86-49d2-4fee-a7d7-0c2761c084fa tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:08.145536 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d11d5c86-49d2-4fee-a7d7-0c2761c084fa tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:08.146266 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d11d5c86-49d2-4fee-a7d7-0c2761c084fa tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:08.147754 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d11d5c86-49d2-4fee-a7d7-0c2761c084fa tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:08.153341 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d11d5c86-49d2-4fee-a7d7-0c2761c084fa tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:08.300856 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-aef3fe63-f5b8-486d-89f4-4419c412512d req-58dacc6b-0c74-4456-86c2-c11bf50ad02c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9e4cb99-8342-478c-962e-8b22f512072d", "name": "network-vif-deleted", "tag": "3e945f63-8c31-4674-aeb5-a32565e47756"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:33:08.306646 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-aef3fe63-f5b8-486d-89f4-4419c412512d req-58dacc6b-0c74-4456-86c2-c11bf50ad02c service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:08.307345 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-aef3fe63-f5b8-486d-89f4-4419c412512d req-58dacc6b-0c74-4456-86c2-c11bf50ad02c service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:08.322141 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-aef3fe63-f5b8-486d-89f4-4419c412512d req-58dacc6b-0c74-4456-86c2-c11bf50ad02c service nova] Creating event network-vif-deleted:3e945f63-8c31-4674-aeb5-a32565e47756 for instance d9e4cb99-8342-478c-962e-8b22f512072d on hv-cinder-83608 May 10 21:33:08.328457 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-aef3fe63-f5b8-486d-89f4-4419c412512d req-58dacc6b-0c74-4456-86c2-c11bf50ad02c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099975 May 10 21:33:08.330560 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 513/1024] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:33:08.350536 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-d11d5c86-49d2-4fee-a7d7-0c2761c084fa tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:08.359807 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-d11d5c86-49d2-4fee-a7d7-0c2761c084fa tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1515 microversion: 2.1 time: 0.228290 May 10 21:33:08.363326 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 512/1025] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:08 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1515 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:33:08.972245 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-97d2dba3-4e3a-4e57-a976-65f1b533bffd tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:08.973068 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-97d2dba3-4e3a-4e57-a976-65f1b533bffd tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: d9e4cb99-8342-478c-962e-8b22f512072d] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:08.979384 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-97d2dba3-4e3a-4e57-a976-65f1b533bffd tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:08.979825 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-97d2dba3-4e3a-4e57-a976-65f1b533bffd tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:08.980585 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-97d2dba3-4e3a-4e57-a976-65f1b533bffd tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:08.981011 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-97d2dba3-4e3a-4e57-a976-65f1b533bffd tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:09.011932 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-97d2dba3-4e3a-4e57-a976-65f1b533bffd tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:09.012371 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-97d2dba3-4e3a-4e57-a976-65f1b533bffd tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:09.012807 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.objects.instance [None req-97d2dba3-4e3a-4e57-a976-65f1b533bffd tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lazy-loading 'fault' on Instance uuid d9e4cb99-8342-478c-962e-8b22f512072d {{(pid=117678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:33:09.059407 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-97d2dba3-4e3a-4e57-a976-65f1b533bffd tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:09.067275 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-97d2dba3-4e3a-4e57-a976-65f1b533bffd tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d" status: 200 len: 1230 microversion: 2.1 time: 0.100453 May 10 21:33:09.067863 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 514/1026] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:08 2022] GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:33:09.377543 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-48369e0c-8a40-47b6-a3dc-62fdff788673 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:09.378160 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-48369e0c-8a40-47b6-a3dc-62fdff788673 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:09.384908 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-48369e0c-8a40-47b6-a3dc-62fdff788673 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:09.385349 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-48369e0c-8a40-47b6-a3dc-62fdff788673 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:09.386111 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-48369e0c-8a40-47b6-a3dc-62fdff788673 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:09.386568 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-48369e0c-8a40-47b6-a3dc-62fdff788673 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:09.530747 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-48369e0c-8a40-47b6-a3dc-62fdff788673 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:09.538684 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-48369e0c-8a40-47b6-a3dc-62fdff788673 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1517 microversion: 2.1 time: 0.165514 May 10 21:33:09.544397 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 513/1027] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:09 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1517 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:33:10.085005 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-edb081c4-51a5-461c-a396-48f2d97b621d tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:10.085610 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-edb081c4-51a5-461c-a396-48f2d97b621d tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: d9e4cb99-8342-478c-962e-8b22f512072d] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:10.092014 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-edb081c4-51a5-461c-a396-48f2d97b621d tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:10.092524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-edb081c4-51a5-461c-a396-48f2d97b621d tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:10.093287 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-edb081c4-51a5-461c-a396-48f2d97b621d tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:10.093718 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-edb081c4-51a5-461c-a396-48f2d97b621d tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:10.107063 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.wsgi [None req-edb081c4-51a5-461c-a396-48f2d97b621d tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] HTTP exception thrown: Instance d9e4cb99-8342-478c-962e-8b22f512072d could not be found. May 10 21:33:10.109414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-edb081c4-51a5-461c-a396-48f2d97b621d tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Request method failure captured: May 10 21:33:10.109414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: request: GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d HTTP/1.1 May 10 21:33:10.109414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept: application/json May 10 21:33:10.109414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept-Encoding: identity May 10 21:33:10.109414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Connection: close May 10 21:33:10.109414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Length: 0 May 10 21:33:10.109414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Type: application/json May 10 21:33:10.109414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Host: 10.222.0.25 May 10 21:33:10.109414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Openstack-System-Scope: None May 10 21:33:10.109414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: User-Agent: python-urllib3/1.26.9 May 10 21:33:10.109414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Auth-Token: gAAAAABietlur2mue2fVt6UC9g-J2nXfoB7AjS6CXP5Qv4pKsFV_CVaO3GKhjDPbaI_mr5Xry7xIRr8s_qC7CypehsxS4AAjd_WGlOh7gKJN0R8M1AP06HezQpfdr0W8R9IECqdXhWttceAwRVPX8pSuXVFfkKOLXPXdO-pRhFtDciHV5K1dZCc May 10 21:33:10.109414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Id: None May 10 21:33:10.109414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Name: None May 10 21:33:10.109414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Identity-Status: Confirmed May 10 21:33:10.109414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Is-Admin-Project: True May 10 21:33:10.109414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Id: default May 10 21:33:10.109414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Name: Default May 10 21:33:10.109414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Id: dd6f673d1cfd41028e5ed60d4d204666 May 10 21:33:10.109414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Name: tempest-TestVolumeBootPattern-652640446 May 10 21:33:10.109414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Role: member,reader May 10 21:33:10.109414 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Roles: member,reader May 10 21:33:10.111159 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dd6f673d1cfd41028e5ed60d4d204666"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_dd6f673d1cfd41028e5ed60d4d204666"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dd6f673d1cfd41028e5ed60d4d204666"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/dd6f673d1cfd41028e5ed60d4d204666"}]}] May 10 21:33:10.111159 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant: tempest-TestVolumeBootPattern-652640446 May 10 21:33:10.111159 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Id: dd6f673d1cfd41028e5ed60d4d204666 May 10 21:33:10.111159 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Name: tempest-TestVolumeBootPattern-652640446 May 10 21:33:10.111159 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User: tempest-TestVolumeBootPattern-652640446-project May 10 21:33:10.111159 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Id: default May 10 21:33:10.111159 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Name: Default May 10 21:33:10.111159 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Id: 6802e5cde5bb48e2958124c88a7501d9 May 10 21:33:10.111159 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Name: tempest-TestVolumeBootPattern-652640446-project May 10 21:33:10.111159 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: method: > May 10 21:33:10.111159 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: exception: Instance d9e4cb99-8342-478c-962e-8b22f512072d could not be found. May 10 21:33:10.111159 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: action_args: {'id': 'd9e4cb99-8342-478c-962e-8b22f512072d'} May 10 21:33:10.112186 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:33:10.112186 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:33:10.112186 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:33:10.112186 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:33:10.112186 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:33:10.112186 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:33:10.112186 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:33:10.112186 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:33:10.112186 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:33:10.112186 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:33:10.112186 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9e4cb99-8342-478c-962e-8b22f512072d could not be found. May 10 21:33:10.112186 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:33:10.112186 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:33:10.112186 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:33:10.112186 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:33:10.112186 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:33:10.112186 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:33:10.112186 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:33:10.112186 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:33:10.112186 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:33:10.113524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:33:10.113524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:33:10.113524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:33:10.113524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:33:10.113524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:33:10.113524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:33:10.113524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:33:10.113524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9e4cb99-8342-478c-962e-8b22f512072d could not be found. May 10 21:33:10.113524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:33:10.113524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:33:10.113524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:33:10.113524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:33:10.113524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:33:10.113524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:33:10.113524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:33:10.113524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:33:10.113524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9e4cb99-8342-478c-962e-8b22f512072d could not be found. May 10 21:33:10.113524 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:33:10.114853 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-edb081c4-51a5-461c-a396-48f2d97b621d tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Returning 404 to user: Instance d9e4cb99-8342-478c-962e-8b22f512072d could not be found. {{(pid=117678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:33:10.114853 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-edb081c4-51a5-461c-a396-48f2d97b621d tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d" status: 404 len: 111 microversion: 2.1 time: 0.029669 May 10 21:33:10.114853 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 515/1028] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:10 2022] GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:33:10.159255 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-184b3f41-c5e6-43d9-876b-506570c6a780 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-509715874", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-548372847", "security_groups": [{"name": "tempest-secgroup-smoke-855147982"}], "block_device_mapping_v2": [{"uuid": "4f68d6ad-4c57-4f2a-a8a5-f27dfa62fee0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "48d591e9-fc52-4c70-9c70-8d7c37800f78"}]}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:33:10.315288 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.network.neutron [None req-184b3f41-c5e6-43d9-876b-506570c6a780 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] validate_networks() for [('48d591e9-fc52-4c70-9c70-8d7c37800f78', None, None, None, None, None)] {{(pid=117679) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 21:33:10.559808 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-827ea2c4-3a6c-45af-82f1-966c459f6bc5 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:10.560413 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-827ea2c4-3a6c-45af-82f1-966c459f6bc5 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:10.566375 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-827ea2c4-3a6c-45af-82f1-966c459f6bc5 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:10.566846 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-827ea2c4-3a6c-45af-82f1-966c459f6bc5 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:10.567623 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-827ea2c4-3a6c-45af-82f1-966c459f6bc5 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:10.568051 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-827ea2c4-3a6c-45af-82f1-966c459f6bc5 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:10.702679 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-827ea2c4-3a6c-45af-82f1-966c459f6bc5 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:10.711078 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-827ea2c4-3a6c-45af-82f1-966c459f6bc5 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1573 microversion: 2.1 time: 0.155133 May 10 21:33:10.711754 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 516/1029] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:10 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:10.884539 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-184b3f41-c5e6-43d9-876b-506570c6a780 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Flavor limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 21:33:10.885033 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-184b3f41-c5e6-43d9-876b-506570c6a780 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Image limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 21:33:10.885349 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-184b3f41-c5e6-43d9-876b-506570c6a780 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Flavor pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 21:33:10.885745 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-184b3f41-c5e6-43d9-876b-506570c6a780 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Image pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 21:33:10.886145 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-184b3f41-c5e6-43d9-876b-506570c6a780 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 21:33:10.895418 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-184b3f41-c5e6-43d9-876b-506570c6a780 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:10.895854 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-184b3f41-c5e6-43d9-876b-506570c6a780 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:10.896642 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-184b3f41-c5e6-43d9-876b-506570c6a780 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:10.897064 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-184b3f41-c5e6-43d9-876b-506570c6a780 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:10.912894 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-184b3f41-c5e6-43d9-876b-506570c6a780 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Getting quotas for project dd6f673d1cfd41028e5ed60d4d204666. Resources: {'cores', 'instances', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:33:10.917535 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-184b3f41-c5e6-43d9-876b-506570c6a780 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Getting quotas for user 6802e5cde5bb48e2958124c88a7501d9 and project dd6f673d1cfd41028e5ed60d4d204666. Resources: {'cores', 'instances', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:33:10.972974 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-184b3f41-c5e6-43d9-876b-506570c6a780 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Going to run 1 instances... {{(pid=117679) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 21:33:10.975116 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-184b3f41-c5e6-43d9-876b-506570c6a780 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 31927753-f8a8-4a62-8a56-c875a464157a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4f68d6ad-4c57-4f2a-a8a5-f27dfa62fee0',volume_size=None,volume_type=None)] {{(pid=117679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 21:33:11.401021 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-184b3f41-c5e6-43d9-876b-506570c6a780 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.245556 May 10 21:33:11.401665 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 514/1030] 10.222.0.25 () {60 vars in 1146 bytes} [Tue May 10 21:33:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 1247 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 21:33:11.411607 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-73e17652-6484-4cae-9447-e26e03645abe tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:11.419278 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-73e17652-6484-4cae-9447-e26e03645abe tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 31927753-f8a8-4a62-8a56-c875a464157a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:11.464348 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-73e17652-6484-4cae-9447-e26e03645abe tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:11.471062 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-73e17652-6484-4cae-9447-e26e03645abe tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a" status: 200 len: 1093 microversion: 2.1 time: 0.063307 May 10 21:33:11.471628 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 517/1031] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:11 2022] GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a => generated 1093 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:33:11.729018 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-c1cb84c6-428e-4604-9eb9-fa4a297a16bf tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:11.729631 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-c1cb84c6-428e-4604-9eb9-fa4a297a16bf tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:11.736620 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c1cb84c6-428e-4604-9eb9-fa4a297a16bf tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:11.737061 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c1cb84c6-428e-4604-9eb9-fa4a297a16bf tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:11.737819 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c1cb84c6-428e-4604-9eb9-fa4a297a16bf tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:11.738250 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c1cb84c6-428e-4604-9eb9-fa4a297a16bf tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:11.865925 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-c1cb84c6-428e-4604-9eb9-fa4a297a16bf tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:11.873347 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-c1cb84c6-428e-4604-9eb9-fa4a297a16bf tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1573 microversion: 2.1 time: 0.148158 May 10 21:33:11.874106 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 515/1032] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:11 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1573 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:33:12.487925 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-5af8839e-aa50-419f-9cc3-ff26d327b914 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:12.488543 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-5af8839e-aa50-419f-9cc3-ff26d327b914 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 31927753-f8a8-4a62-8a56-c875a464157a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:12.543460 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-5af8839e-aa50-419f-9cc3-ff26d327b914 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:12.550110 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-5af8839e-aa50-419f-9cc3-ff26d327b914 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a" status: 200 len: 1093 microversion: 2.1 time: 0.066130 May 10 21:33:12.550717 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 518/1033] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:12 2022] GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:33:12.889675 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-73d88fb3-deff-4a58-9129-ef44590eb993 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:12.890281 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-73d88fb3-deff-4a58-9129-ef44590eb993 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:12.896686 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-73d88fb3-deff-4a58-9129-ef44590eb993 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:12.897130 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-73d88fb3-deff-4a58-9129-ef44590eb993 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:12.897898 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-73d88fb3-deff-4a58-9129-ef44590eb993 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:12.898329 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-73d88fb3-deff-4a58-9129-ef44590eb993 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:13.025696 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-73d88fb3-deff-4a58-9129-ef44590eb993 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:13.033613 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-73d88fb3-deff-4a58-9129-ef44590eb993 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1573 microversion: 2.1 time: 0.147839 May 10 21:33:13.034178 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 516/1034] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:12 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1573 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:33:13.566728 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-c203f8d7-5405-4a5a-9fbe-1b24beb2234c tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:13.567336 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-c203f8d7-5405-4a5a-9fbe-1b24beb2234c tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 31927753-f8a8-4a62-8a56-c875a464157a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:13.622089 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-c203f8d7-5405-4a5a-9fbe-1b24beb2234c tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:13.628848 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-c203f8d7-5405-4a5a-9fbe-1b24beb2234c tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a" status: 200 len: 1093 microversion: 2.1 time: 0.065993 May 10 21:33:13.629682 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 519/1035] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:13 2022] GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:33:14.051160 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-5eb9855d-7a29-41fa-9490-e0ccfc49839e tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:14.051923 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-5eb9855d-7a29-41fa-9490-e0ccfc49839e tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:14.059497 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5eb9855d-7a29-41fa-9490-e0ccfc49839e tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:14.059947 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5eb9855d-7a29-41fa-9490-e0ccfc49839e tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:14.061701 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5eb9855d-7a29-41fa-9490-e0ccfc49839e tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:14.062140 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5eb9855d-7a29-41fa-9490-e0ccfc49839e tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:14.221530 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-5eb9855d-7a29-41fa-9490-e0ccfc49839e tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:14.229252 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-5eb9855d-7a29-41fa-9490-e0ccfc49839e tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1573 microversion: 2.1 time: 0.182002 May 10 21:33:14.229823 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 517/1036] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:14 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1573 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:33:14.645904 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-713f52d3-0148-4253-8472-033b79c38049 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:14.646572 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-713f52d3-0148-4253-8472-033b79c38049 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 31927753-f8a8-4a62-8a56-c875a464157a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:14.698397 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-713f52d3-0148-4253-8472-033b79c38049 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:14.705676 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-713f52d3-0148-4253-8472-033b79c38049 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a" status: 200 len: 1093 microversion: 2.1 time: 0.063564 May 10 21:33:14.706572 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 520/1037] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:14 2022] GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a => generated 1093 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:33:15.248078 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4802ee6a-397a-4e48-bf39-02db09a18421 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:15.248626 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-4802ee6a-397a-4e48-bf39-02db09a18421 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:15.255274 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4802ee6a-397a-4e48-bf39-02db09a18421 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:15.255721 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4802ee6a-397a-4e48-bf39-02db09a18421 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:15.256759 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4802ee6a-397a-4e48-bf39-02db09a18421 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:15.257191 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4802ee6a-397a-4e48-bf39-02db09a18421 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:15.385007 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-4802ee6a-397a-4e48-bf39-02db09a18421 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:15.393320 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4802ee6a-397a-4e48-bf39-02db09a18421 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1573 microversion: 2.1 time: 0.149308 May 10 21:33:15.393885 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 518/1038] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:15 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1573 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:33:15.722327 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-48c57b48-b166-48e7-8963-03fae7965868 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:15.722956 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-48c57b48-b166-48e7-8963-03fae7965868 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 31927753-f8a8-4a62-8a56-c875a464157a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:15.729446 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-48c57b48-b166-48e7-8963-03fae7965868 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:15.729891 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-48c57b48-b166-48e7-8963-03fae7965868 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:15.730686 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-48c57b48-b166-48e7-8963-03fae7965868 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:15.731118 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-48c57b48-b166-48e7-8963-03fae7965868 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:15.791092 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-48c57b48-b166-48e7-8963-03fae7965868 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:15.798997 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-48c57b48-b166-48e7-8963-03fae7965868 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a" status: 200 len: 1143 microversion: 2.1 time: 0.080467 May 10 21:33:15.799555 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 521/1039] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:15 2022] GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a => generated 1143 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:33:16.409756 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-604a2399-3865-4b4f-b35d-697cc18cacde tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:16.410306 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-604a2399-3865-4b4f-b35d-697cc18cacde tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:16.416675 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-604a2399-3865-4b4f-b35d-697cc18cacde tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:16.417126 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-604a2399-3865-4b4f-b35d-697cc18cacde tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:16.417881 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-604a2399-3865-4b4f-b35d-697cc18cacde tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:16.418309 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-604a2399-3865-4b4f-b35d-697cc18cacde tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:16.551260 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-604a2399-3865-4b4f-b35d-697cc18cacde tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:16.559287 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-604a2399-3865-4b4f-b35d-697cc18cacde tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1573 microversion: 2.1 time: 0.153413 May 10 21:33:16.560355 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 519/1040] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:16 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:33:16.816307 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-869b7429-d148-43ef-be6e-f005097498ad tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:16.816906 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-869b7429-d148-43ef-be6e-f005097498ad tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 31927753-f8a8-4a62-8a56-c875a464157a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:16.823183 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-869b7429-d148-43ef-be6e-f005097498ad tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:16.823634 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-869b7429-d148-43ef-be6e-f005097498ad tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:16.825451 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-869b7429-d148-43ef-be6e-f005097498ad tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:16.825887 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-869b7429-d148-43ef-be6e-f005097498ad tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:16.889552 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-869b7429-d148-43ef-be6e-f005097498ad tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:16.897299 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-869b7429-d148-43ef-be6e-f005097498ad tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a" status: 200 len: 1143 microversion: 2.1 time: 0.085090 May 10 21:33:16.898030 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 522/1041] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:16 2022] GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a => generated 1143 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:33:17.578505 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-d1f1f61e-f1f5-46cd-b66d-329318db5f35 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:17.579990 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-d1f1f61e-f1f5-46cd-b66d-329318db5f35 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:17.597072 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d1f1f61e-f1f5-46cd-b66d-329318db5f35 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:17.597577 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d1f1f61e-f1f5-46cd-b66d-329318db5f35 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:17.598362 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d1f1f61e-f1f5-46cd-b66d-329318db5f35 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:17.598827 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d1f1f61e-f1f5-46cd-b66d-329318db5f35 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:17.821082 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-d1f1f61e-f1f5-46cd-b66d-329318db5f35 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:17.829852 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-d1f1f61e-f1f5-46cd-b66d-329318db5f35 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1573 microversion: 2.1 time: 0.256650 May 10 21:33:17.830460 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 520/1042] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:17 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1573 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:33:17.913165 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-1eb406cd-743e-481e-b58b-d24babd8cf3b tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:17.913766 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-1eb406cd-743e-481e-b58b-d24babd8cf3b tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 31927753-f8a8-4a62-8a56-c875a464157a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:17.927267 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1eb406cd-743e-481e-b58b-d24babd8cf3b tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:17.927750 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1eb406cd-743e-481e-b58b-d24babd8cf3b tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:17.928540 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1eb406cd-743e-481e-b58b-d24babd8cf3b tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:17.928973 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-1eb406cd-743e-481e-b58b-d24babd8cf3b tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:17.997011 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-1eb406cd-743e-481e-b58b-d24babd8cf3b tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:18.004806 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-1eb406cd-743e-481e-b58b-d24babd8cf3b tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a" status: 200 len: 1209 microversion: 2.1 time: 0.095628 May 10 21:33:18.005424 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 523/1043] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:17 2022] GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a => generated 1209 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:33:18.846951 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-fbc3ccad-c5a8-4fa1-8812-e4cbe18cca6f tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:18.847860 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-fbc3ccad-c5a8-4fa1-8812-e4cbe18cca6f tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:18.857457 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fbc3ccad-c5a8-4fa1-8812-e4cbe18cca6f tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:18.857966 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fbc3ccad-c5a8-4fa1-8812-e4cbe18cca6f tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:18.858823 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fbc3ccad-c5a8-4fa1-8812-e4cbe18cca6f tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:18.859265 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fbc3ccad-c5a8-4fa1-8812-e4cbe18cca6f tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:19.023774 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-0ce533d6-e5f4-4bbe-8a90-66f1e29df280 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:19.024400 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-0ce533d6-e5f4-4bbe-8a90-66f1e29df280 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 31927753-f8a8-4a62-8a56-c875a464157a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:19.031037 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0ce533d6-e5f4-4bbe-8a90-66f1e29df280 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:19.031713 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0ce533d6-e5f4-4bbe-8a90-66f1e29df280 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:19.032496 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0ce533d6-e5f4-4bbe-8a90-66f1e29df280 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:19.032935 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-0ce533d6-e5f4-4bbe-8a90-66f1e29df280 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:19.050897 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-fbc3ccad-c5a8-4fa1-8812-e4cbe18cca6f tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:19.058996 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-fbc3ccad-c5a8-4fa1-8812-e4cbe18cca6f tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1573 microversion: 2.1 time: 0.216210 May 10 21:33:19.059605 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 521/1044] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:18 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1573 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:33:19.163644 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-0ce533d6-e5f4-4bbe-8a90-66f1e29df280 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:19.171259 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-0ce533d6-e5f4-4bbe-8a90-66f1e29df280 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a" status: 200 len: 1264 microversion: 2.1 time: 0.151574 May 10 21:33:19.171869 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 524/1045] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:19 2022] GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:19.467536 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-c0ba963c-b138-4490-b8d7-eda34394fcb7 req-bcb7b3df-8df9-4df6-971c-edaafb1e6012 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31927753-f8a8-4a62-8a56-c875a464157a", "tag": "d86b5666-939c-498a-8aa7-42bf74c4eca2"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:33:19.481834 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-c0ba963c-b138-4490-b8d7-eda34394fcb7 req-bcb7b3df-8df9-4df6-971c-edaafb1e6012 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:19.483317 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-c0ba963c-b138-4490-b8d7-eda34394fcb7 req-bcb7b3df-8df9-4df6-971c-edaafb1e6012 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:19.496860 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-c0ba963c-b138-4490-b8d7-eda34394fcb7 req-bcb7b3df-8df9-4df6-971c-edaafb1e6012 service nova] Creating event network-changed:d86b5666-939c-498a-8aa7-42bf74c4eca2 for instance 31927753-f8a8-4a62-8a56-c875a464157a on hv-cinder-83608 May 10 21:33:19.503000 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-c0ba963c-b138-4490-b8d7-eda34394fcb7 req-bcb7b3df-8df9-4df6-971c-edaafb1e6012 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041072 May 10 21:33:19.503784 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 522/1046] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:33:19.742472 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-edca2dc2-4cc6-48be-a54e-56e6b6f29dfc req-c43767f6-6543-4858-a658-9b1a46464286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84148312-3a13-4e3f-b60a-a70b63d71910", "name": "network-vif-plugged", "status": "completed", "tag": "4d7713f5-cbd0-420c-8d5e-b66a3e380a1d"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:33:19.751328 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-edca2dc2-4cc6-48be-a54e-56e6b6f29dfc req-c43767f6-6543-4858-a658-9b1a46464286 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:19.751841 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-edca2dc2-4cc6-48be-a54e-56e6b6f29dfc req-c43767f6-6543-4858-a658-9b1a46464286 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:19.763582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-edca2dc2-4cc6-48be-a54e-56e6b6f29dfc req-c43767f6-6543-4858-a658-9b1a46464286 service nova] Creating event network-vif-plugged:4d7713f5-cbd0-420c-8d5e-b66a3e380a1d for instance 84148312-3a13-4e3f-b60a-a70b63d71910 on hv-cinder-83608 May 10 21:33:19.768778 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-edca2dc2-4cc6-48be-a54e-56e6b6f29dfc req-c43767f6-6543-4858-a658-9b1a46464286 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030363 May 10 21:33:19.769453 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 525/1047] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:33:20.077475 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4e79dc3e-a2d5-4238-a5f6-eed19b7ca543 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:20.078167 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-4e79dc3e-a2d5-4238-a5f6-eed19b7ca543 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:20.084353 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4e79dc3e-a2d5-4238-a5f6-eed19b7ca543 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:20.084804 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4e79dc3e-a2d5-4238-a5f6-eed19b7ca543 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:20.085559 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4e79dc3e-a2d5-4238-a5f6-eed19b7ca543 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:20.085981 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4e79dc3e-a2d5-4238-a5f6-eed19b7ca543 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:20.190025 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-9646ef2e-e817-4dbd-b920-0ea55f621c4f tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:20.191013 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-9646ef2e-e817-4dbd-b920-0ea55f621c4f tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 31927753-f8a8-4a62-8a56-c875a464157a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:20.197108 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9646ef2e-e817-4dbd-b920-0ea55f621c4f tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:20.197622 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9646ef2e-e817-4dbd-b920-0ea55f621c4f tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:20.198472 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9646ef2e-e817-4dbd-b920-0ea55f621c4f tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:20.199047 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9646ef2e-e817-4dbd-b920-0ea55f621c4f tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:20.288201 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-4e79dc3e-a2d5-4238-a5f6-eed19b7ca543 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:20.296260 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4e79dc3e-a2d5-4238-a5f6-eed19b7ca543 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1573 microversion: 2.1 time: 0.223943 May 10 21:33:20.296831 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 523/1048] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:20 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1573 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:33:20.340952 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-9646ef2e-e817-4dbd-b920-0ea55f621c4f tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:20.348256 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-9646ef2e-e817-4dbd-b920-0ea55f621c4f tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a" status: 200 len: 1264 microversion: 2.1 time: 0.163566 May 10 21:33:20.348928 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 526/1049] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:20 2022] GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:21.313203 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a468506b-17c4-40f5-a111-18ba4cb760a6 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:21.313904 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-a468506b-17c4-40f5-a111-18ba4cb760a6 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:21.321342 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a468506b-17c4-40f5-a111-18ba4cb760a6 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:21.321793 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a468506b-17c4-40f5-a111-18ba4cb760a6 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:21.322674 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a468506b-17c4-40f5-a111-18ba4cb760a6 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:21.323106 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a468506b-17c4-40f5-a111-18ba4cb760a6 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:21.365095 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-cde9f0e4-d5b7-442f-8793-d2a61bdff761 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:21.365708 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-cde9f0e4-d5b7-442f-8793-d2a61bdff761 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 31927753-f8a8-4a62-8a56-c875a464157a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:21.372244 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-cde9f0e4-d5b7-442f-8793-d2a61bdff761 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:21.373225 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-cde9f0e4-d5b7-442f-8793-d2a61bdff761 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:21.374186 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-cde9f0e4-d5b7-442f-8793-d2a61bdff761 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:21.374643 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-cde9f0e4-d5b7-442f-8793-d2a61bdff761 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:21.464441 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-a468506b-17c4-40f5-a111-18ba4cb760a6 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:21.473000 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-a468506b-17c4-40f5-a111-18ba4cb760a6 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1573 microversion: 2.1 time: 0.163687 May 10 21:33:21.473576 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 524/1050] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:21 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1573 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:33:21.510677 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-cde9f0e4-d5b7-442f-8793-d2a61bdff761 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:21.518049 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-cde9f0e4-d5b7-442f-8793-d2a61bdff761 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a" status: 200 len: 1264 microversion: 2.1 time: 0.156791 May 10 21:33:21.518643 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 527/1051] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:21 2022] GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:22.505043 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-54780666-a0e9-4a03-9b35-224d0b041a53 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:22.505043 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-54780666-a0e9-4a03-9b35-224d0b041a53 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:22.505043 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-54780666-a0e9-4a03-9b35-224d0b041a53 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:22.505043 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-54780666-a0e9-4a03-9b35-224d0b041a53 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:22.505962 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-54780666-a0e9-4a03-9b35-224d0b041a53 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:22.505962 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-54780666-a0e9-4a03-9b35-224d0b041a53 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:22.535027 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-f03c39fa-6472-4489-a560-2c6dd30bd7e8 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:22.535659 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-f03c39fa-6472-4489-a560-2c6dd30bd7e8 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 31927753-f8a8-4a62-8a56-c875a464157a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:22.544074 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f03c39fa-6472-4489-a560-2c6dd30bd7e8 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:22.544516 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f03c39fa-6472-4489-a560-2c6dd30bd7e8 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:22.546082 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f03c39fa-6472-4489-a560-2c6dd30bd7e8 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:22.546538 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f03c39fa-6472-4489-a560-2c6dd30bd7e8 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:22.630904 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-54780666-a0e9-4a03-9b35-224d0b041a53 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:22.638926 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-54780666-a0e9-4a03-9b35-224d0b041a53 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1560 microversion: 2.1 time: 0.152217 May 10 21:33:22.639598 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 525/1052] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:22 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:33:22.675990 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-f03c39fa-6472-4489-a560-2c6dd30bd7e8 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:22.683274 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-f03c39fa-6472-4489-a560-2c6dd30bd7e8 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a" status: 200 len: 1264 microversion: 2.1 time: 0.152250 May 10 21:33:22.683839 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 528/1053] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:22 2022] GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:23.699567 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-45074406-1c1b-4a47-97d5-6c5490245b38 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:23.700314 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-45074406-1c1b-4a47-97d5-6c5490245b38 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 31927753-f8a8-4a62-8a56-c875a464157a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:23.707365 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-45074406-1c1b-4a47-97d5-6c5490245b38 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:23.707805 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-45074406-1c1b-4a47-97d5-6c5490245b38 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:23.708554 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-45074406-1c1b-4a47-97d5-6c5490245b38 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:23.708980 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-45074406-1c1b-4a47-97d5-6c5490245b38 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:24.093946 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-45074406-1c1b-4a47-97d5-6c5490245b38 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:24.101157 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-45074406-1c1b-4a47-97d5-6c5490245b38 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a" status: 200 len: 1264 microversion: 2.1 time: 0.405413 May 10 21:33:24.101718 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 526/1054] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:23 2022] GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a => generated 1264 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:33:25.117609 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-39cf03d7-2216-43a7-8615-ade9215aa419 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:25.118216 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-39cf03d7-2216-43a7-8615-ade9215aa419 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 31927753-f8a8-4a62-8a56-c875a464157a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:25.125273 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-39cf03d7-2216-43a7-8615-ade9215aa419 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:25.125714 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-39cf03d7-2216-43a7-8615-ade9215aa419 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:25.126491 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-39cf03d7-2216-43a7-8615-ade9215aa419 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:25.126925 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-39cf03d7-2216-43a7-8615-ade9215aa419 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:25.256491 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-39cf03d7-2216-43a7-8615-ade9215aa419 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:25.264520 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-39cf03d7-2216-43a7-8615-ade9215aa419 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a" status: 200 len: 1264 microversion: 2.1 time: 0.150713 May 10 21:33:25.265087 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 529/1055] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:25 2022] GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:33:26.282225 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4eba3dee-acab-4006-bb72-bf64c3afcb3b tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:26.282864 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-4eba3dee-acab-4006-bb72-bf64c3afcb3b tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 31927753-f8a8-4a62-8a56-c875a464157a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:26.289219 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4eba3dee-acab-4006-bb72-bf64c3afcb3b tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:26.289661 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4eba3dee-acab-4006-bb72-bf64c3afcb3b tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:26.290420 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4eba3dee-acab-4006-bb72-bf64c3afcb3b tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:26.290881 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4eba3dee-acab-4006-bb72-bf64c3afcb3b tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:26.417041 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-4eba3dee-acab-4006-bb72-bf64c3afcb3b tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:26.425051 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4eba3dee-acab-4006-bb72-bf64c3afcb3b tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a" status: 200 len: 1264 microversion: 2.1 time: 0.147697 May 10 21:33:26.425659 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 527/1056] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:26 2022] GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:33:27.442543 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-9c9235ab-878c-4f5f-9d44-90ffe9c0c983 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:27.443149 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-9c9235ab-878c-4f5f-9d44-90ffe9c0c983 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 31927753-f8a8-4a62-8a56-c875a464157a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:27.449954 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9c9235ab-878c-4f5f-9d44-90ffe9c0c983 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:27.450428 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9c9235ab-878c-4f5f-9d44-90ffe9c0c983 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:27.452208 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9c9235ab-878c-4f5f-9d44-90ffe9c0c983 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:27.452390 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9c9235ab-878c-4f5f-9d44-90ffe9c0c983 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:27.580193 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-9c9235ab-878c-4f5f-9d44-90ffe9c0c983 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:27.587571 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-9c9235ab-878c-4f5f-9d44-90ffe9c0c983 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a" status: 200 len: 1264 microversion: 2.1 time: 0.148989 May 10 21:33:27.588136 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 530/1057] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:27 2022] GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:28.604248 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-052a1473-4ca6-45bb-a710-7c797fb1f521 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:28.604865 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-052a1473-4ca6-45bb-a710-7c797fb1f521 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 31927753-f8a8-4a62-8a56-c875a464157a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:28.611330 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-052a1473-4ca6-45bb-a710-7c797fb1f521 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:28.611774 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-052a1473-4ca6-45bb-a710-7c797fb1f521 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:28.612534 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-052a1473-4ca6-45bb-a710-7c797fb1f521 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:28.612968 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-052a1473-4ca6-45bb-a710-7c797fb1f521 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:28.742355 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-052a1473-4ca6-45bb-a710-7c797fb1f521 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:28.749755 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-052a1473-4ca6-45bb-a710-7c797fb1f521 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a" status: 200 len: 1264 microversion: 2.1 time: 0.149369 May 10 21:33:28.750328 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 528/1058] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:28 2022] GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:33:29.766792 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-f3f25fea-b614-46d2-a3df-d83dd8a07f80 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:29.767468 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-f3f25fea-b614-46d2-a3df-d83dd8a07f80 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 31927753-f8a8-4a62-8a56-c875a464157a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:29.774279 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f3f25fea-b614-46d2-a3df-d83dd8a07f80 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:29.774840 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f3f25fea-b614-46d2-a3df-d83dd8a07f80 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:29.778245 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f3f25fea-b614-46d2-a3df-d83dd8a07f80 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:29.778245 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-f3f25fea-b614-46d2-a3df-d83dd8a07f80 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:29.860160 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-9758fe5b-fbb8-4a0c-a7aa-bd089ee5408a req-97dcb7de-50ff-4895-acd0-f33a05424662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31927753-f8a8-4a62-8a56-c875a464157a", "name": "network-vif-plugged", "status": "completed", "tag": "d86b5666-939c-498a-8aa7-42bf74c4eca2"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:33:29.869216 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-9758fe5b-fbb8-4a0c-a7aa-bd089ee5408a req-97dcb7de-50ff-4895-acd0-f33a05424662 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:29.869632 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-9758fe5b-fbb8-4a0c-a7aa-bd089ee5408a req-97dcb7de-50ff-4895-acd0-f33a05424662 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:29.883569 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-9758fe5b-fbb8-4a0c-a7aa-bd089ee5408a req-97dcb7de-50ff-4895-acd0-f33a05424662 service nova] Creating event network-vif-plugged:d86b5666-939c-498a-8aa7-42bf74c4eca2 for instance 31927753-f8a8-4a62-8a56-c875a464157a on hv-cinder-83608 May 10 21:33:29.889266 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-9758fe5b-fbb8-4a0c-a7aa-bd089ee5408a req-97dcb7de-50ff-4895-acd0-f33a05424662 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033773 May 10 21:33:29.890063 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 529/1059] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:33:29.923734 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-f3f25fea-b614-46d2-a3df-d83dd8a07f80 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:29.931301 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-f3f25fea-b614-46d2-a3df-d83dd8a07f80 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a" status: 200 len: 1264 microversion: 2.1 time: 0.168404 May 10 21:33:29.931880 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 531/1060] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:29 2022] GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:33:30.948817 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-166b46d1-09c2-42f8-97c2-5a1ceb02f6e8 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:30.949509 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-166b46d1-09c2-42f8-97c2-5a1ceb02f6e8 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 31927753-f8a8-4a62-8a56-c875a464157a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:30.956271 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-166b46d1-09c2-42f8-97c2-5a1ceb02f6e8 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:30.956707 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-166b46d1-09c2-42f8-97c2-5a1ceb02f6e8 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:30.957493 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-166b46d1-09c2-42f8-97c2-5a1ceb02f6e8 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:30.957921 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-166b46d1-09c2-42f8-97c2-5a1ceb02f6e8 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:31.088838 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-166b46d1-09c2-42f8-97c2-5a1ceb02f6e8 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:31.096990 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-166b46d1-09c2-42f8-97c2-5a1ceb02f6e8 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a" status: 200 len: 1264 microversion: 2.1 time: 0.152360 May 10 21:33:31.097553 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 530/1061] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:30 2022] GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:33:32.113817 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-6ea9fd7d-17b3-4558-a156-eb24935498d7 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:32.114451 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-6ea9fd7d-17b3-4558-a156-eb24935498d7 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 31927753-f8a8-4a62-8a56-c875a464157a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:32.120869 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6ea9fd7d-17b3-4558-a156-eb24935498d7 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:32.121318 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6ea9fd7d-17b3-4558-a156-eb24935498d7 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:32.122086 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6ea9fd7d-17b3-4558-a156-eb24935498d7 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:32.122550 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-6ea9fd7d-17b3-4558-a156-eb24935498d7 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:32.251319 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-6ea9fd7d-17b3-4558-a156-eb24935498d7 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:32.258960 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-6ea9fd7d-17b3-4558-a156-eb24935498d7 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a" status: 200 len: 1451 microversion: 2.1 time: 0.149133 May 10 21:33:32.259539 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 532/1062] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:32 2022] GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:33:32.275256 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-75ffd002-67d7-4186-a0dd-936f12c80f52 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:32.275871 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-75ffd002-67d7-4186-a0dd-936f12c80f52 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 31927753-f8a8-4a62-8a56-c875a464157a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:32.282373 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-75ffd002-67d7-4186-a0dd-936f12c80f52 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:32.282871 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-75ffd002-67d7-4186-a0dd-936f12c80f52 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:32.283638 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-75ffd002-67d7-4186-a0dd-936f12c80f52 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:32.284074 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-75ffd002-67d7-4186-a0dd-936f12c80f52 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:32.416083 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-75ffd002-67d7-4186-a0dd-936f12c80f52 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:32.424054 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-75ffd002-67d7-4186-a0dd-936f12c80f52 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a" status: 200 len: 1451 microversion: 2.1 time: 0.152623 May 10 21:33:32.424787 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 531/1063] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:33:32 2022] GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:33:34.474396 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-b14e45dc-6ed5-4c83-9aa4-31be18997c01 req-c0869695-8a77-458e-9c47-481fd4e5fbcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31927753-f8a8-4a62-8a56-c875a464157a", "tag": "d86b5666-939c-498a-8aa7-42bf74c4eca2"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:33:34.483628 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-b14e45dc-6ed5-4c83-9aa4-31be18997c01 req-c0869695-8a77-458e-9c47-481fd4e5fbcc service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:34.484205 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-b14e45dc-6ed5-4c83-9aa4-31be18997c01 req-c0869695-8a77-458e-9c47-481fd4e5fbcc service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:34.494977 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-b14e45dc-6ed5-4c83-9aa4-31be18997c01 req-c0869695-8a77-458e-9c47-481fd4e5fbcc service nova] Creating event network-changed:d86b5666-939c-498a-8aa7-42bf74c4eca2 for instance 31927753-f8a8-4a62-8a56-c875a464157a on hv-cinder-83608 May 10 21:33:34.500907 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-b14e45dc-6ed5-4c83-9aa4-31be18997c01 req-c0869695-8a77-458e-9c47-481fd4e5fbcc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030177 May 10 21:33:34.501512 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 533/1064] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:34:37.636890 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-d88a05ca-5a86-4026-b1e1-57bf0ca6ada9 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:37.637452 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-d88a05ca-5a86-4026-b1e1-57bf0ca6ada9 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:37.641066 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-7aa8068b-45a7-416d-9000-6c611ad892c2 req-63535241-a05e-48c7-9302-87a7b21a77b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84148312-3a13-4e3f-b60a-a70b63d71910", "tag": "4d7713f5-cbd0-420c-8d5e-b66a3e380a1d"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:34:37.644016 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d88a05ca-5a86-4026-b1e1-57bf0ca6ada9 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:37.644458 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d88a05ca-5a86-4026-b1e1-57bf0ca6ada9 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:37.645291 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d88a05ca-5a86-4026-b1e1-57bf0ca6ada9 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:37.645724 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d88a05ca-5a86-4026-b1e1-57bf0ca6ada9 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:37.650481 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-7aa8068b-45a7-416d-9000-6c611ad892c2 req-63535241-a05e-48c7-9302-87a7b21a77b4 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:37.650896 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-7aa8068b-45a7-416d-9000-6c611ad892c2 req-63535241-a05e-48c7-9302-87a7b21a77b4 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:37.662055 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-7aa8068b-45a7-416d-9000-6c611ad892c2 req-63535241-a05e-48c7-9302-87a7b21a77b4 service nova] Creating event network-changed:4d7713f5-cbd0-420c-8d5e-b66a3e380a1d for instance 84148312-3a13-4e3f-b60a-a70b63d71910 on hv-cinder-83608 May 10 21:34:37.668296 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-7aa8068b-45a7-416d-9000-6c611ad892c2 req-63535241-a05e-48c7-9302-87a7b21a77b4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033508 May 10 21:34:37.669656 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 534/1065] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:34:37.672145 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-d88a05ca-5a86-4026-b1e1-57bf0ca6ada9 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Going to try to terminate instance {{(pid=117679) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 21:34:37.995223 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-d88a05ca-5a86-4026-b1e1-57bf0ca6ada9 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "DELETE /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 204 len: 0 microversion: 2.1 time: 0.359013 May 10 21:34:37.995223 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 532/1066] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 10 21:34:37 2022] DELETE /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 21:34:38.001149 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-8febdd47-38eb-4770-a27e-678affb30b92 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:38.001978 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-8febdd47-38eb-4770-a27e-678affb30b92 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:38.009238 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8febdd47-38eb-4770-a27e-678affb30b92 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:38.009680 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8febdd47-38eb-4770-a27e-678affb30b92 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:38.010458 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8febdd47-38eb-4770-a27e-678affb30b92 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:38.010897 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8febdd47-38eb-4770-a27e-678affb30b92 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:38.148516 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-8febdd47-38eb-4770-a27e-678affb30b92 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:38.155995 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-8febdd47-38eb-4770-a27e-678affb30b92 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1566 microversion: 2.1 time: 0.159087 May 10 21:34:38.156798 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 535/1067] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:34:37 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:39.176018 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-927102f0-27c5-4645-8096-ef6659707e7f tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:39.176827 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-927102f0-27c5-4645-8096-ef6659707e7f tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:39.184762 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-927102f0-27c5-4645-8096-ef6659707e7f tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:39.185213 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-927102f0-27c5-4645-8096-ef6659707e7f tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:39.185989 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-927102f0-27c5-4645-8096-ef6659707e7f tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:39.186427 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-927102f0-27c5-4645-8096-ef6659707e7f tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:39.318017 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-927102f0-27c5-4645-8096-ef6659707e7f tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:39.325624 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-927102f0-27c5-4645-8096-ef6659707e7f tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1566 microversion: 2.1 time: 0.154292 May 10 21:34:39.326188 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 533/1068] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:34:39 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:40.025863 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-95d3637d-c545-444e-a254-4aa454169127 req-34b25d85-24c1-4ae9-9fa6-7d3e59eab062 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84148312-3a13-4e3f-b60a-a70b63d71910", "name": "network-vif-deleted", "tag": "4d7713f5-cbd0-420c-8d5e-b66a3e380a1d"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:34:40.034016 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-95d3637d-c545-444e-a254-4aa454169127 req-34b25d85-24c1-4ae9-9fa6-7d3e59eab062 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:40.039773 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-95d3637d-c545-444e-a254-4aa454169127 req-34b25d85-24c1-4ae9-9fa6-7d3e59eab062 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:40.088636 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-95d3637d-c545-444e-a254-4aa454169127 req-34b25d85-24c1-4ae9-9fa6-7d3e59eab062 service nova] Creating event network-vif-deleted:4d7713f5-cbd0-420c-8d5e-b66a3e380a1d for instance 84148312-3a13-4e3f-b60a-a70b63d71910 on hv-cinder-83608 May 10 21:34:40.093632 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-95d3637d-c545-444e-a254-4aa454169127 req-34b25d85-24c1-4ae9-9fa6-7d3e59eab062 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072008 May 10 21:34:40.094198 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 536/1069] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:34:40.345567 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-cfdccbcd-25d0-47e1-8cd0-b635c69df0a9 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:40.346638 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-cfdccbcd-25d0-47e1-8cd0-b635c69df0a9 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:40.354084 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cfdccbcd-25d0-47e1-8cd0-b635c69df0a9 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:40.354084 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cfdccbcd-25d0-47e1-8cd0-b635c69df0a9 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:40.355305 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cfdccbcd-25d0-47e1-8cd0-b635c69df0a9 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:40.355810 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cfdccbcd-25d0-47e1-8cd0-b635c69df0a9 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:40.421995 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-cfdccbcd-25d0-47e1-8cd0-b635c69df0a9 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efdf21c4f62e44cca32de43efd532418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419939c78a2449e6a958b430e0e14d04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:40.430318 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-cfdccbcd-25d0-47e1-8cd0-b635c69df0a9 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 200 len: 1219 microversion: 2.1 time: 0.088580 May 10 21:34:40.430941 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 534/1070] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:34:40 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:41.448380 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-37d864eb-9679-42ba-a4ce-9c01999da043 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:41.449655 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-37d864eb-9679-42ba-a4ce-9c01999da043 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [instance: 84148312-3a13-4e3f-b60a-a70b63d71910] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:41.455747 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-37d864eb-9679-42ba-a4ce-9c01999da043 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:41.456188 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-37d864eb-9679-42ba-a4ce-9c01999da043 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:41.456943 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-37d864eb-9679-42ba-a4ce-9c01999da043 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:41.457415 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-37d864eb-9679-42ba-a4ce-9c01999da043 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:41.470645 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.wsgi [None req-37d864eb-9679-42ba-a4ce-9c01999da043 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] HTTP exception thrown: Instance 84148312-3a13-4e3f-b60a-a70b63d71910 could not be found. May 10 21:34:41.472230 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-37d864eb-9679-42ba-a4ce-9c01999da043 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Request method failure captured: May 10 21:34:41.472230 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: request: GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 HTTP/1.1 May 10 21:34:41.472230 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept: application/json May 10 21:34:41.472230 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept-Encoding: identity May 10 21:34:41.472230 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Connection: close May 10 21:34:41.472230 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Length: 0 May 10 21:34:41.472230 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Type: application/json May 10 21:34:41.472230 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Host: 10.222.0.25 May 10 21:34:41.472230 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Openstack-System-Scope: None May 10 21:34:41.472230 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: User-Agent: python-urllib3/1.26.9 May 10 21:34:41.472230 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Auth-Token: gAAAAABietlfe5--PN4g1WAP5nbsQ9rsq83g3YYdlARZCuSCBQchTCkvlPxtpRYwHNQuVnGbEk-Y9E02en5Br7rO_xe-fF90LLzqEKTHwnHlbxjrwrxEdzDFqG6ao0-BCBJxNXQitF9Kw0VbXSOhtYn7cXJ0EWQVPi9H7n9QOEIWQ8n1s3VuCVA May 10 21:34:41.472230 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Id: None May 10 21:34:41.472230 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Name: None May 10 21:34:41.472230 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Identity-Status: Confirmed May 10 21:34:41.472230 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Is-Admin-Project: True May 10 21:34:41.472230 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Id: default May 10 21:34:41.472230 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Name: Default May 10 21:34:41.472230 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Id: 419939c78a2449e6a958b430e0e14d04 May 10 21:34:41.472230 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Name: tempest-TestShelveInstance-1614631392 May 10 21:34:41.472230 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Role: member,reader May 10 21:34:41.472230 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Roles: member,reader May 10 21:34:41.473982 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/419939c78a2449e6a958b430e0e14d04"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_419939c78a2449e6a958b430e0e14d04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/419939c78a2449e6a958b430e0e14d04"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/419939c78a2449e6a958b430e0e14d04"}]}] May 10 21:34:41.473982 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant: tempest-TestShelveInstance-1614631392 May 10 21:34:41.473982 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Id: 419939c78a2449e6a958b430e0e14d04 May 10 21:34:41.473982 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Name: tempest-TestShelveInstance-1614631392 May 10 21:34:41.473982 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User: tempest-TestShelveInstance-1614631392-project May 10 21:34:41.473982 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Id: default May 10 21:34:41.473982 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Name: Default May 10 21:34:41.473982 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Id: efdf21c4f62e44cca32de43efd532418 May 10 21:34:41.473982 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Name: tempest-TestShelveInstance-1614631392-project May 10 21:34:41.473982 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: method: > May 10 21:34:41.473982 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: exception: Instance 84148312-3a13-4e3f-b60a-a70b63d71910 could not be found. May 10 21:34:41.473982 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: action_args: {'id': '84148312-3a13-4e3f-b60a-a70b63d71910'} May 10 21:34:41.475093 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:34:41.475093 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:34:41.475093 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:34:41.475093 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:34:41.475093 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:34:41.475093 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:34:41.475093 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:34:41.475093 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:34:41.475093 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:34:41.475093 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:34:41.475093 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84148312-3a13-4e3f-b60a-a70b63d71910 could not be found. May 10 21:34:41.475093 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:34:41.475093 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:34:41.475093 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:34:41.475093 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:34:41.475093 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:34:41.475093 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:34:41.475093 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:34:41.475093 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:34:41.475093 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:34:41.476716 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:34:41.476716 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:34:41.476716 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:34:41.476716 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:34:41.476716 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:34:41.476716 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:34:41.476716 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:34:41.476716 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84148312-3a13-4e3f-b60a-a70b63d71910 could not be found. May 10 21:34:41.476716 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:34:41.476716 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:34:41.476716 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:34:41.476716 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:34:41.476716 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:34:41.476716 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:34:41.476716 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:34:41.476716 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:34:41.476716 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84148312-3a13-4e3f-b60a-a70b63d71910 could not be found. May 10 21:34:41.476716 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:34:41.478251 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-37d864eb-9679-42ba-a4ce-9c01999da043 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Returning 404 to user: Instance 84148312-3a13-4e3f-b60a-a70b63d71910 could not be found. {{(pid=117678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:34:41.478251 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-37d864eb-9679-42ba-a4ce-9c01999da043 tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910" status: 404 len: 111 microversion: 2.1 time: 0.030081 May 10 21:34:41.478251 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 537/1071] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:34:41 2022] GET /compute/v2.1/servers/84148312-3a13-4e3f-b60a-a70b63d71910 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:34:41.711369 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-81dfcd3b-dfbb-4ba0-a82a-22047a300dad tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] Calling method '.version_select at 0x7f7aea59cca0>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:41.715637 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR oslo.messaging._drivers.impl_rabbit [None req-81dfcd3b-dfbb-4ba0-a82a-22047a300dad tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [bb1d34ee-195f-4ab6-b273-7350ae697953] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 10 21:34:42.723923 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO oslo.messaging._drivers.impl_rabbit [None req-81dfcd3b-dfbb-4ba0-a82a-22047a300dad tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] [bb1d34ee-195f-4ab6-b273-7350ae697953] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 57186. May 10 21:34:42.797763 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-81dfcd3b-dfbb-4ba0-a82a-22047a300dad tempest-TestShelveInstance-1614631392 tempest-TestShelveInstance-1614631392-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1344486950" status: 202 len: 0 microversion: 2.1 time: 1.090304 May 10 21:34:42.798337 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 535/1072] 10.222.0.25 () {58 vars in 1253 bytes} [Tue May 10 21:34:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1344486950 => generated 0 bytes in 1092 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 21:35:20.694327 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-5432ec9c-f526-4806-a0d9-0857caa621ea tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1500336816", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-548372847", "security_groups": [{"name": "tempest-secgroup-smoke-855147982"}], "block_device_mapping_v2": [{"uuid": "8f9941c4-2a40-4344-b72d-126e7bc68b04", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "48d591e9-fc52-4c70-9c70-8d7c37800f78"}]}} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:35:20.802173 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.network.neutron [None req-5432ec9c-f526-4806-a0d9-0857caa621ea tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] validate_networks() for [('48d591e9-fc52-4c70-9c70-8d7c37800f78', None, None, None, None, None)] {{(pid=117678) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 21:35:21.155630 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-5432ec9c-f526-4806-a0d9-0857caa621ea tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Flavor limits 0:0:0 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 21:35:21.156054 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-5432ec9c-f526-4806-a0d9-0857caa621ea tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Image limits 0:0:0 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 21:35:21.156525 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-5432ec9c-f526-4806-a0d9-0857caa621ea tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Flavor pref 0:0:0 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 21:35:21.156931 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-5432ec9c-f526-4806-a0d9-0857caa621ea tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Image pref 0:0:0 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 21:35:21.157341 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.virt.hardware [None req-5432ec9c-f526-4806-a0d9-0857caa621ea tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 21:35:21.165943 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5432ec9c-f526-4806-a0d9-0857caa621ea tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:21.166384 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5432ec9c-f526-4806-a0d9-0857caa621ea tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:21.167217 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5432ec9c-f526-4806-a0d9-0857caa621ea tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:21.167651 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5432ec9c-f526-4806-a0d9-0857caa621ea tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:21.184966 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.quota [None req-5432ec9c-f526-4806-a0d9-0857caa621ea tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Getting quotas for project dd6f673d1cfd41028e5ed60d4d204666. Resources: {'cores', 'instances', 'ram'} {{(pid=117678) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:35:21.188865 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.quota [None req-5432ec9c-f526-4806-a0d9-0857caa621ea tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Getting quotas for user 6802e5cde5bb48e2958124c88a7501d9 and project dd6f673d1cfd41028e5ed60d4d204666. Resources: {'cores', 'instances', 'ram'} {{(pid=117678) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:35:21.244416 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-5432ec9c-f526-4806-a0d9-0857caa621ea tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Going to run 1 instances... {{(pid=117678) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 21:35:21.246543 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-5432ec9c-f526-4806-a0d9-0857caa621ea tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8f9941c4-2a40-4344-b72d-126e7bc68b04',volume_size=None,volume_type=None)] {{(pid=117678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 21:35:21.632872 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-5432ec9c-f526-4806-a0d9-0857caa621ea tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.942358 May 10 21:35:21.633519 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 538/1073] 10.222.0.25 () {60 vars in 1146 bytes} [Tue May 10 21:35:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 944 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 21:35:21.644305 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-8bda1f80-6520-4ce3-b01b-c1881db33c57 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:21.644922 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-8bda1f80-6520-4ce3-b01b-c1881db33c57 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:21.697430 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8bda1f80-6520-4ce3-b01b-c1881db33c57 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:21.704158 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-8bda1f80-6520-4ce3-b01b-c1881db33c57 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3" status: 200 len: 1094 microversion: 2.1 time: 0.064241 May 10 21:35:21.705044 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 536/1074] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:35:21 2022] GET /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:22.722599 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-cc663bbb-39df-479f-8566-bf572fcec959 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:22.723250 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-cc663bbb-39df-479f-8566-bf572fcec959 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:22.730174 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-cc663bbb-39df-479f-8566-bf572fcec959 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:22.730629 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-cc663bbb-39df-479f-8566-bf572fcec959 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:22.731404 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-cc663bbb-39df-479f-8566-bf572fcec959 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:22.732401 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-cc663bbb-39df-479f-8566-bf572fcec959 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:22.795371 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-cc663bbb-39df-479f-8566-bf572fcec959 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:22.803033 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-cc663bbb-39df-479f-8566-bf572fcec959 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3" status: 200 len: 1136 microversion: 2.1 time: 0.085587 May 10 21:35:22.804675 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 539/1075] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:35:22 2022] GET /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3 => generated 1136 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:23.820086 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-ba74190a-322f-45d6-a011-c2fc9338685b tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:23.820654 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-ba74190a-322f-45d6-a011-c2fc9338685b tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:23.828253 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ba74190a-322f-45d6-a011-c2fc9338685b tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:23.828703 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ba74190a-322f-45d6-a011-c2fc9338685b tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:23.829486 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ba74190a-322f-45d6-a011-c2fc9338685b tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:23.829921 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ba74190a-322f-45d6-a011-c2fc9338685b tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:23.913234 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-ba74190a-322f-45d6-a011-c2fc9338685b tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:23.921184 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-ba74190a-322f-45d6-a011-c2fc9338685b tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3" status: 200 len: 1210 microversion: 2.1 time: 0.105218 May 10 21:35:23.921752 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 537/1076] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:35:23 2022] GET /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3 => generated 1210 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:24.939722 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-bb2dfb05-315f-4409-a143-4b969bfd4047 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:24.940378 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-bb2dfb05-315f-4409-a143-4b969bfd4047 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:24.947311 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-bb2dfb05-315f-4409-a143-4b969bfd4047 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:24.947834 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-bb2dfb05-315f-4409-a143-4b969bfd4047 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:24.948739 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-bb2dfb05-315f-4409-a143-4b969bfd4047 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:24.949296 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-bb2dfb05-315f-4409-a143-4b969bfd4047 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:25.071600 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-5d487bdb-62c7-463f-8f3e-4831ed415923 req-05207c64-b30c-4787-8e04-c8c2dd61c115 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3", "tag": "ed260500-9dc1-4582-a776-ea1484daeec3"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:35:25.079907 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-5d487bdb-62c7-463f-8f3e-4831ed415923 req-05207c64-b30c-4787-8e04-c8c2dd61c115 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:25.080600 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-5d487bdb-62c7-463f-8f3e-4831ed415923 req-05207c64-b30c-4787-8e04-c8c2dd61c115 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:25.093847 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-5d487bdb-62c7-463f-8f3e-4831ed415923 req-05207c64-b30c-4787-8e04-c8c2dd61c115 service nova] Creating event network-changed:ed260500-9dc1-4582-a776-ea1484daeec3 for instance 7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3 on hv-cinder-83608 May 10 21:35:25.097663 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-bb2dfb05-315f-4409-a143-4b969bfd4047 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:25.101812 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-5d487bdb-62c7-463f-8f3e-4831ed415923 req-05207c64-b30c-4787-8e04-c8c2dd61c115 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031538 May 10 21:35:25.102470 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 538/1077] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:35:25.106235 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-bb2dfb05-315f-4409-a143-4b969bfd4047 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3" status: 200 len: 1265 microversion: 2.1 time: 0.172008 May 10 21:35:25.107962 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 540/1078] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:35:24 2022] GET /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:25.340709 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 21:35:25.340894 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Tue May 10 21:35:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 21:35:26.126023 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-8ad2e93b-58f8-452d-8291-f8da03078a7e tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:26.126776 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-8ad2e93b-58f8-452d-8291-f8da03078a7e tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:26.133142 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8ad2e93b-58f8-452d-8291-f8da03078a7e tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:26.133586 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8ad2e93b-58f8-452d-8291-f8da03078a7e tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:26.134367 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8ad2e93b-58f8-452d-8291-f8da03078a7e tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:26.134824 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8ad2e93b-58f8-452d-8291-f8da03078a7e tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:26.267704 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8ad2e93b-58f8-452d-8291-f8da03078a7e tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:26.274880 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-8ad2e93b-58f8-452d-8291-f8da03078a7e tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3" status: 200 len: 1265 microversion: 2.1 time: 0.153527 May 10 21:35:26.275441 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 539/1079] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:35:26 2022] GET /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:27.292307 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-a7e724e8-f1bc-4d13-91db-a4cf897f5608 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:27.292944 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-a7e724e8-f1bc-4d13-91db-a4cf897f5608 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:27.299919 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-a7e724e8-f1bc-4d13-91db-a4cf897f5608 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:27.300363 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-a7e724e8-f1bc-4d13-91db-a4cf897f5608 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:27.301113 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-a7e724e8-f1bc-4d13-91db-a4cf897f5608 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:27.301538 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-a7e724e8-f1bc-4d13-91db-a4cf897f5608 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:27.429208 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-a7e724e8-f1bc-4d13-91db-a4cf897f5608 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:27.436967 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-a7e724e8-f1bc-4d13-91db-a4cf897f5608 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3" status: 200 len: 1265 microversion: 2.1 time: 0.148572 May 10 21:35:27.439622 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 541/1080] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:35:27 2022] GET /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:28.456045 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a5c78d8c-f467-4402-9fd1-35cac3f73b5e tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:28.456654 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-a5c78d8c-f467-4402-9fd1-35cac3f73b5e tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:28.462962 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a5c78d8c-f467-4402-9fd1-35cac3f73b5e tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:28.463411 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a5c78d8c-f467-4402-9fd1-35cac3f73b5e tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:28.464166 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a5c78d8c-f467-4402-9fd1-35cac3f73b5e tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:28.464597 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a5c78d8c-f467-4402-9fd1-35cac3f73b5e tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:28.593090 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-a5c78d8c-f467-4402-9fd1-35cac3f73b5e tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:28.600388 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-a5c78d8c-f467-4402-9fd1-35cac3f73b5e tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3" status: 200 len: 1265 microversion: 2.1 time: 0.148888 May 10 21:35:28.600948 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 540/1081] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:35:28 2022] GET /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:29.726156 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-767873ce-7efa-4ec0-b383-bbf4bc311e7e tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:29.726795 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-767873ce-7efa-4ec0-b383-bbf4bc311e7e tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:29.733386 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-767873ce-7efa-4ec0-b383-bbf4bc311e7e tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:29.733829 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-767873ce-7efa-4ec0-b383-bbf4bc311e7e tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:29.734621 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-767873ce-7efa-4ec0-b383-bbf4bc311e7e tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:29.735051 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-767873ce-7efa-4ec0-b383-bbf4bc311e7e tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:29.865055 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-767873ce-7efa-4ec0-b383-bbf4bc311e7e tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:29.873055 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-767873ce-7efa-4ec0-b383-bbf4bc311e7e tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3" status: 200 len: 1265 microversion: 2.1 time: 0.258566 May 10 21:35:29.873655 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 542/1082] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:35:29 2022] GET /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3 => generated 1265 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:30.891370 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6f344c74-ad90-48e7-89f2-56cf80a84c21 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:30.891984 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-6f344c74-ad90-48e7-89f2-56cf80a84c21 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:30.898004 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6f344c74-ad90-48e7-89f2-56cf80a84c21 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:30.898462 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6f344c74-ad90-48e7-89f2-56cf80a84c21 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:30.899245 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6f344c74-ad90-48e7-89f2-56cf80a84c21 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:30.899676 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6f344c74-ad90-48e7-89f2-56cf80a84c21 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:31.093130 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-6f344c74-ad90-48e7-89f2-56cf80a84c21 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:31.100410 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-6f344c74-ad90-48e7-89f2-56cf80a84c21 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3" status: 200 len: 1265 microversion: 2.1 time: 0.213506 May 10 21:35:31.100969 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 541/1083] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:35:30 2022] GET /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3 => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:32.117815 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-e769d819-85bf-46ad-b14e-bde572e0efd1 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:32.118418 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-e769d819-85bf-46ad-b14e-bde572e0efd1 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:32.124821 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e769d819-85bf-46ad-b14e-bde572e0efd1 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:32.125260 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e769d819-85bf-46ad-b14e-bde572e0efd1 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:32.126017 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e769d819-85bf-46ad-b14e-bde572e0efd1 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:32.126459 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-e769d819-85bf-46ad-b14e-bde572e0efd1 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:32.255259 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-e769d819-85bf-46ad-b14e-bde572e0efd1 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:32.262407 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-e769d819-85bf-46ad-b14e-bde572e0efd1 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3" status: 200 len: 1265 microversion: 2.1 time: 0.148416 May 10 21:35:32.263509 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 543/1084] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:35:32 2022] GET /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:33.280212 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-0ab1facd-2dca-4ff2-a4de-0285bb45cf17 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:33.280818 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-0ab1facd-2dca-4ff2-a4de-0285bb45cf17 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:33.287129 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0ab1facd-2dca-4ff2-a4de-0285bb45cf17 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:33.287567 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0ab1facd-2dca-4ff2-a4de-0285bb45cf17 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:33.288318 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0ab1facd-2dca-4ff2-a4de-0285bb45cf17 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:33.288743 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0ab1facd-2dca-4ff2-a4de-0285bb45cf17 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:33.417737 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-0ab1facd-2dca-4ff2-a4de-0285bb45cf17 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:33.426674 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-0ab1facd-2dca-4ff2-a4de-0285bb45cf17 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3" status: 200 len: 1265 microversion: 2.1 time: 0.150697 May 10 21:35:33.427256 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 542/1085] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:35:33 2022] GET /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:34.443711 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-5c8a6a5d-c2a3-4b15-b109-0b2f314a8400 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:34.444319 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-5c8a6a5d-c2a3-4b15-b109-0b2f314a8400 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:34.451166 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5c8a6a5d-c2a3-4b15-b109-0b2f314a8400 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:34.451603 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5c8a6a5d-c2a3-4b15-b109-0b2f314a8400 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:34.452358 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5c8a6a5d-c2a3-4b15-b109-0b2f314a8400 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:34.452823 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-5c8a6a5d-c2a3-4b15-b109-0b2f314a8400 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:34.684447 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-5c8a6a5d-c2a3-4b15-b109-0b2f314a8400 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:34.691996 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-5c8a6a5d-c2a3-4b15-b109-0b2f314a8400 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3" status: 200 len: 1265 microversion: 2.1 time: 0.252195 May 10 21:35:34.692574 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 544/1086] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:35:34 2022] GET /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3 => generated 1265 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:35.708720 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-16fb4ce5-8d85-4e78-a7b6-90b67a144564 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:35.709324 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-16fb4ce5-8d85-4e78-a7b6-90b67a144564 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:35.716341 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-16fb4ce5-8d85-4e78-a7b6-90b67a144564 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:35.716785 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-16fb4ce5-8d85-4e78-a7b6-90b67a144564 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:35.717540 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-16fb4ce5-8d85-4e78-a7b6-90b67a144564 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:35.717967 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-16fb4ce5-8d85-4e78-a7b6-90b67a144564 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:35.900392 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-16fb4ce5-8d85-4e78-a7b6-90b67a144564 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:35.908499 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-16fb4ce5-8d85-4e78-a7b6-90b67a144564 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3" status: 200 len: 1265 microversion: 2.1 time: 0.203645 May 10 21:35:35.909065 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 543/1087] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:35:35 2022] GET /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3 => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:36.341605 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-182d56dd-5d5e-4df6-be99-a0e1749afae0 req-39d787b8-3098-4f1b-8d8f-107bfa70bd50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3", "name": "network-vif-plugged", "status": "completed", "tag": "ed260500-9dc1-4582-a776-ea1484daeec3"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:35:36.350253 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-182d56dd-5d5e-4df6-be99-a0e1749afae0 req-39d787b8-3098-4f1b-8d8f-107bfa70bd50 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:36.350740 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-182d56dd-5d5e-4df6-be99-a0e1749afae0 req-39d787b8-3098-4f1b-8d8f-107bfa70bd50 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:36.362048 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-182d56dd-5d5e-4df6-be99-a0e1749afae0 req-39d787b8-3098-4f1b-8d8f-107bfa70bd50 service nova] Creating event network-vif-plugged:ed260500-9dc1-4582-a776-ea1484daeec3 for instance 7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3 on hv-cinder-83608 May 10 21:35:36.367319 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-182d56dd-5d5e-4df6-be99-a0e1749afae0 req-39d787b8-3098-4f1b-8d8f-107bfa70bd50 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029923 May 10 21:35:36.367840 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 545/1088] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:35:36.925115 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-1ec54bf8-a9a1-469c-83c9-9e4ed2b69b3c tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:36.925727 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-1ec54bf8-a9a1-469c-83c9-9e4ed2b69b3c tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:36.932086 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1ec54bf8-a9a1-469c-83c9-9e4ed2b69b3c tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:36.932532 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1ec54bf8-a9a1-469c-83c9-9e4ed2b69b3c tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:36.933297 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1ec54bf8-a9a1-469c-83c9-9e4ed2b69b3c tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:36.933732 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1ec54bf8-a9a1-469c-83c9-9e4ed2b69b3c tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:37.064304 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1ec54bf8-a9a1-469c-83c9-9e4ed2b69b3c tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:37.071586 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-1ec54bf8-a9a1-469c-83c9-9e4ed2b69b3c tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3" status: 200 len: 1265 microversion: 2.1 time: 0.150318 May 10 21:35:37.072152 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 544/1089] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:35:36 2022] GET /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:38.092402 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-9c7f5768-f0cb-4b3c-8558-8e99d0e4924e tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:38.093098 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-9c7f5768-f0cb-4b3c-8558-8e99d0e4924e tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:38.099357 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9c7f5768-f0cb-4b3c-8558-8e99d0e4924e tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:38.104839 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9c7f5768-f0cb-4b3c-8558-8e99d0e4924e tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:38.104839 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9c7f5768-f0cb-4b3c-8558-8e99d0e4924e tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:38.104839 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-9c7f5768-f0cb-4b3c-8558-8e99d0e4924e tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:38.230313 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-9c7f5768-f0cb-4b3c-8558-8e99d0e4924e tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:38.238556 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-9c7f5768-f0cb-4b3c-8558-8e99d0e4924e tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3" status: 200 len: 1452 microversion: 2.1 time: 0.150994 May 10 21:35:38.239132 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 546/1090] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:35:38 2022] GET /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:38.255311 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-025c0ced-be61-4f86-982e-8d387727b214 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:38.255921 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-025c0ced-be61-4f86-982e-8d387727b214 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:38.262175 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-025c0ced-be61-4f86-982e-8d387727b214 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:38.262911 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-025c0ced-be61-4f86-982e-8d387727b214 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:38.263688 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-025c0ced-be61-4f86-982e-8d387727b214 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:38.264124 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-025c0ced-be61-4f86-982e-8d387727b214 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:38.391005 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-025c0ced-be61-4f86-982e-8d387727b214 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:38.398324 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-025c0ced-be61-4f86-982e-8d387727b214 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3" status: 200 len: 1452 microversion: 2.1 time: 0.147020 May 10 21:35:38.398924 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 545/1091] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:35:38 2022] GET /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3 => generated 1452 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:40.527081 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-51e02de7-1dd9-490c-a2e6-f8e45caeb903 req-69412a8e-7f31-4b10-af8e-811ef4dbd442 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3", "tag": "ed260500-9dc1-4582-a776-ea1484daeec3"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:35:40.536716 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-51e02de7-1dd9-490c-a2e6-f8e45caeb903 req-69412a8e-7f31-4b10-af8e-811ef4dbd442 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:40.537154 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-51e02de7-1dd9-490c-a2e6-f8e45caeb903 req-69412a8e-7f31-4b10-af8e-811ef4dbd442 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:40.548244 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-51e02de7-1dd9-490c-a2e6-f8e45caeb903 req-69412a8e-7f31-4b10-af8e-811ef4dbd442 service nova] Creating event network-changed:ed260500-9dc1-4582-a776-ea1484daeec3 for instance 7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3 on hv-cinder-83608 May 10 21:35:40.553111 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-51e02de7-1dd9-490c-a2e6-f8e45caeb903 req-69412a8e-7f31-4b10-af8e-811ef4dbd442 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029791 May 10 21:35:40.553696 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 547/1092] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:37:08.311777 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-c60336c3-dc62-4f0e-8529-a5a6b8dea712 req-43134169-e38b-4108-bbab-6a7ce3714425 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3", "tag": "ed260500-9dc1-4582-a776-ea1484daeec3"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:37:08.319147 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-21fa3e91-9337-4687-a5b2-d7d197b3d40b tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:08.319812 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-21fa3e91-9337-4687-a5b2-d7d197b3d40b tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:08.321040 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-c60336c3-dc62-4f0e-8529-a5a6b8dea712 req-43134169-e38b-4108-bbab-6a7ce3714425 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:08.321686 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-c60336c3-dc62-4f0e-8529-a5a6b8dea712 req-43134169-e38b-4108-bbab-6a7ce3714425 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:08.323343 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR oslo.messaging._drivers.impl_rabbit [-] [216e0015-8044-4d5a-943e-a2e6e0739d7b] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 10 21:37:08.326675 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-21fa3e91-9337-4687-a5b2-d7d197b3d40b tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:08.327373 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-21fa3e91-9337-4687-a5b2-d7d197b3d40b tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:08.328146 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-21fa3e91-9337-4687-a5b2-d7d197b3d40b tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:08.328581 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-21fa3e91-9337-4687-a5b2-d7d197b3d40b tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:08.334506 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-c60336c3-dc62-4f0e-8529-a5a6b8dea712 req-43134169-e38b-4108-bbab-6a7ce3714425 service nova] Creating event network-changed:ed260500-9dc1-4582-a776-ea1484daeec3 for instance 7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3 on hv-cinder-83608 May 10 21:37:08.340100 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-c60336c3-dc62-4f0e-8529-a5a6b8dea712 req-43134169-e38b-4108-bbab-6a7ce3714425 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033704 May 10 21:37:08.340726 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 548/1093] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:37:08.358196 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-21fa3e91-9337-4687-a5b2-d7d197b3d40b tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3] Going to try to terminate instance {{(pid=117679) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 21:37:08.661611 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-21fa3e91-9337-4687-a5b2-d7d197b3d40b tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3" status: 204 len: 0 microversion: 2.1 time: 0.357063 May 10 21:37:08.662400 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 546/1094] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 10 21:37:08 2022] DELETE /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 21:37:08.672956 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-50531ee9-ab64-46c1-8eb6-62fc8287f44d tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:08.673588 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-50531ee9-ab64-46c1-8eb6-62fc8287f44d tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:08.681163 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-50531ee9-ab64-46c1-8eb6-62fc8287f44d tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:08.681682 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-50531ee9-ab64-46c1-8eb6-62fc8287f44d tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:08.682575 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-50531ee9-ab64-46c1-8eb6-62fc8287f44d tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:08.683197 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-50531ee9-ab64-46c1-8eb6-62fc8287f44d tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:08.818521 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-50531ee9-ab64-46c1-8eb6-62fc8287f44d tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:08.826062 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-50531ee9-ab64-46c1-8eb6-62fc8287f44d tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3" status: 200 len: 1576 microversion: 2.1 time: 0.157923 May 10 21:37:08.826759 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 549/1095] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:37:08 2022] GET /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:09.844384 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a1d56e25-11da-4fdd-bc03-76df48b98d32 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:09.845094 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-a1d56e25-11da-4fdd-bc03-76df48b98d32 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:09.852986 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a1d56e25-11da-4fdd-bc03-76df48b98d32 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:09.853718 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a1d56e25-11da-4fdd-bc03-76df48b98d32 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:09.854637 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a1d56e25-11da-4fdd-bc03-76df48b98d32 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:09.854973 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a1d56e25-11da-4fdd-bc03-76df48b98d32 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:09.874934 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO oslo.messaging._drivers.impl_rabbit [-] [216e0015-8044-4d5a-943e-a2e6e0739d7b] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 57360. May 10 21:37:10.016071 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-a1d56e25-11da-4fdd-bc03-76df48b98d32 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:10.023791 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-a1d56e25-11da-4fdd-bc03-76df48b98d32 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3" status: 200 len: 1576 microversion: 2.1 time: 0.183710 May 10 21:37:10.024359 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 547/1096] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:37:09 2022] GET /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3 => generated 1576 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:37:10.689289 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-37f6d625-38f5-4d8f-a83c-5dee4cbd8086 req-b9314c1a-b3ea-4ef1-9246-70577a355377 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3", "name": "network-vif-deleted", "tag": "ed260500-9dc1-4582-a776-ea1484daeec3"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:37:10.697303 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-37f6d625-38f5-4d8f-a83c-5dee4cbd8086 req-b9314c1a-b3ea-4ef1-9246-70577a355377 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:10.701473 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-37f6d625-38f5-4d8f-a83c-5dee4cbd8086 req-b9314c1a-b3ea-4ef1-9246-70577a355377 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:10.708855 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-37f6d625-38f5-4d8f-a83c-5dee4cbd8086 req-b9314c1a-b3ea-4ef1-9246-70577a355377 service nova] Creating event network-vif-deleted:ed260500-9dc1-4582-a776-ea1484daeec3 for instance 7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3 on hv-cinder-83608 May 10 21:37:10.713872 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-37f6d625-38f5-4d8f-a83c-5dee4cbd8086 req-b9314c1a-b3ea-4ef1-9246-70577a355377 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028244 May 10 21:37:10.714471 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 550/1097] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:37:11.042210 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6bb71584-a1a4-412a-ad8e-23933f9eb732 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:11.043169 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-6bb71584-a1a4-412a-ad8e-23933f9eb732 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:11.050667 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6bb71584-a1a4-412a-ad8e-23933f9eb732 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:11.051118 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6bb71584-a1a4-412a-ad8e-23933f9eb732 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:11.052001 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6bb71584-a1a4-412a-ad8e-23933f9eb732 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:11.053119 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6bb71584-a1a4-412a-ad8e-23933f9eb732 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:11.119293 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-6bb71584-a1a4-412a-ad8e-23933f9eb732 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:11.127241 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-6bb71584-a1a4-412a-ad8e-23933f9eb732 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3" status: 200 len: 1225 microversion: 2.1 time: 0.089554 May 10 21:37:11.132181 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 548/1098] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:37:11 2022] GET /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:37:12.145049 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-3866d9d8-bfb6-4de5-bb48-405b405174bc tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:12.145832 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-3866d9d8-bfb6-4de5-bb48-405b405174bc tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:12.152026 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3866d9d8-bfb6-4de5-bb48-405b405174bc tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:12.152466 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3866d9d8-bfb6-4de5-bb48-405b405174bc tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:12.153222 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3866d9d8-bfb6-4de5-bb48-405b405174bc tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:12.153649 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-3866d9d8-bfb6-4de5-bb48-405b405174bc tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:12.167044 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.wsgi [None req-3866d9d8-bfb6-4de5-bb48-405b405174bc tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] HTTP exception thrown: Instance 7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3 could not be found. May 10 21:37:12.168630 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-3866d9d8-bfb6-4de5-bb48-405b405174bc tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Request method failure captured: May 10 21:37:12.168630 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: request: GET /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3 HTTP/1.1 May 10 21:37:12.168630 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept: application/json May 10 21:37:12.168630 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept-Encoding: identity May 10 21:37:12.168630 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Connection: close May 10 21:37:12.168630 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Length: 0 May 10 21:37:12.168630 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Type: application/json May 10 21:37:12.168630 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Host: 10.222.0.25 May 10 21:37:12.168630 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Openstack-System-Scope: None May 10 21:37:12.168630 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: User-Agent: python-urllib3/1.26.9 May 10 21:37:12.168630 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Auth-Token: gAAAAABietlur2mue2fVt6UC9g-J2nXfoB7AjS6CXP5Qv4pKsFV_CVaO3GKhjDPbaI_mr5Xry7xIRr8s_qC7CypehsxS4AAjd_WGlOh7gKJN0R8M1AP06HezQpfdr0W8R9IECqdXhWttceAwRVPX8pSuXVFfkKOLXPXdO-pRhFtDciHV5K1dZCc May 10 21:37:12.168630 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Id: None May 10 21:37:12.168630 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Name: None May 10 21:37:12.168630 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Identity-Status: Confirmed May 10 21:37:12.168630 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Is-Admin-Project: True May 10 21:37:12.168630 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Id: default May 10 21:37:12.168630 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Name: Default May 10 21:37:12.168630 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Id: dd6f673d1cfd41028e5ed60d4d204666 May 10 21:37:12.168630 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Name: tempest-TestVolumeBootPattern-652640446 May 10 21:37:12.168630 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Role: member,reader May 10 21:37:12.168630 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Roles: member,reader May 10 21:37:12.170323 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dd6f673d1cfd41028e5ed60d4d204666"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_dd6f673d1cfd41028e5ed60d4d204666"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dd6f673d1cfd41028e5ed60d4d204666"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/dd6f673d1cfd41028e5ed60d4d204666"}]}] May 10 21:37:12.170323 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant: tempest-TestVolumeBootPattern-652640446 May 10 21:37:12.170323 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Id: dd6f673d1cfd41028e5ed60d4d204666 May 10 21:37:12.170323 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Name: tempest-TestVolumeBootPattern-652640446 May 10 21:37:12.170323 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User: tempest-TestVolumeBootPattern-652640446-project May 10 21:37:12.170323 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Id: default May 10 21:37:12.170323 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Name: Default May 10 21:37:12.170323 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Id: 6802e5cde5bb48e2958124c88a7501d9 May 10 21:37:12.170323 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Name: tempest-TestVolumeBootPattern-652640446-project May 10 21:37:12.170323 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: method: > May 10 21:37:12.170323 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: exception: Instance 7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3 could not be found. May 10 21:37:12.170323 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: action_args: {'id': '7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3'} May 10 21:37:12.171503 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:37:12.171503 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:37:12.171503 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:37:12.171503 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:37:12.171503 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:37:12.171503 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:37:12.171503 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:37:12.171503 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:37:12.171503 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:37:12.171503 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:37:12.171503 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3 could not be found. May 10 21:37:12.171503 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:37:12.171503 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:37:12.171503 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:37:12.171503 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:37:12.171503 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:37:12.171503 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:37:12.171503 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:37:12.171503 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:37:12.171503 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:37:12.173158 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:37:12.173158 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:37:12.173158 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:37:12.173158 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:37:12.173158 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:37:12.173158 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:37:12.173158 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:37:12.173158 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3 could not be found. May 10 21:37:12.173158 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:37:12.173158 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:37:12.173158 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:37:12.173158 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:37:12.173158 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:37:12.173158 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:37:12.173158 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:37:12.173158 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:37:12.173158 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3 could not be found. May 10 21:37:12.173158 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:37:12.174829 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-3866d9d8-bfb6-4de5-bb48-405b405174bc tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Returning 404 to user: Instance 7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3 could not be found. {{(pid=117678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:37:12.174829 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-3866d9d8-bfb6-4de5-bb48-405b405174bc tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3" status: 404 len: 111 microversion: 2.1 time: 0.029624 May 10 21:37:12.174829 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 551/1099] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:37:12 2022] GET /compute/v2.1/servers/7d0efbed-df3a-4fa4-9b1c-5601e68d5ee3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:37:15.719863 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-b839a589-555f-4f7d-9499-b1e7d6d1fece tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:15.725722 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-91218a86-7767-4cd0-9e70-6743471166e5 req-db5c30d0-5167-48f8-9e03-6b6a2c624e93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31927753-f8a8-4a62-8a56-c875a464157a", "tag": "d86b5666-939c-498a-8aa7-42bf74c4eca2"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:37:15.726432 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-b839a589-555f-4f7d-9499-b1e7d6d1fece tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 31927753-f8a8-4a62-8a56-c875a464157a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:15.733286 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b839a589-555f-4f7d-9499-b1e7d6d1fece tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:15.733738 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b839a589-555f-4f7d-9499-b1e7d6d1fece tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:15.734551 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b839a589-555f-4f7d-9499-b1e7d6d1fece tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:15.734989 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b839a589-555f-4f7d-9499-b1e7d6d1fece tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:15.737408 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-91218a86-7767-4cd0-9e70-6743471166e5 req-db5c30d0-5167-48f8-9e03-6b6a2c624e93 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:15.737847 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-91218a86-7767-4cd0-9e70-6743471166e5 req-db5c30d0-5167-48f8-9e03-6b6a2c624e93 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:15.756206 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-91218a86-7767-4cd0-9e70-6743471166e5 req-db5c30d0-5167-48f8-9e03-6b6a2c624e93 service nova] Creating event network-changed:d86b5666-939c-498a-8aa7-42bf74c4eca2 for instance 31927753-f8a8-4a62-8a56-c875a464157a on hv-cinder-83608 May 10 21:37:15.761721 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-91218a86-7767-4cd0-9e70-6743471166e5 req-db5c30d0-5167-48f8-9e03-6b6a2c624e93 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040078 May 10 21:37:15.762565 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 552/1100] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:37:15.765809 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-b839a589-555f-4f7d-9499-b1e7d6d1fece tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 31927753-f8a8-4a62-8a56-c875a464157a] Going to try to terminate instance {{(pid=117679) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 21:37:16.050774 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-b839a589-555f-4f7d-9499-b1e7d6d1fece tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "DELETE /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a" status: 204 len: 0 microversion: 2.1 time: 0.334713 May 10 21:37:16.051475 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 549/1101] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 10 21:37:15 2022] DELETE /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 21:37:16.061736 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-09a8b648-bbb2-4776-bcb1-193f3df23519 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:16.063145 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-09a8b648-bbb2-4776-bcb1-193f3df23519 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 31927753-f8a8-4a62-8a56-c875a464157a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:16.072501 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-09a8b648-bbb2-4776-bcb1-193f3df23519 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:16.072967 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-09a8b648-bbb2-4776-bcb1-193f3df23519 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:16.073789 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-09a8b648-bbb2-4776-bcb1-193f3df23519 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:16.074288 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-09a8b648-bbb2-4776-bcb1-193f3df23519 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:16.230945 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.policy [None req-09a8b648-bbb2-4776-bcb1-193f3df23519 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117678) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:16.241523 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-09a8b648-bbb2-4776-bcb1-193f3df23519 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a" status: 200 len: 1576 microversion: 2.1 time: 0.184051 May 10 21:37:16.243287 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 553/1102] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:37:16 2022] GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a => generated 1576 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:37:17.268869 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4c26077d-74b0-46a3-bd68-d508e9d0e8d6 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:17.269569 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-4c26077d-74b0-46a3-bd68-d508e9d0e8d6 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 31927753-f8a8-4a62-8a56-c875a464157a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:17.276825 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4c26077d-74b0-46a3-bd68-d508e9d0e8d6 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:17.277277 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4c26077d-74b0-46a3-bd68-d508e9d0e8d6 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:17.278052 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4c26077d-74b0-46a3-bd68-d508e9d0e8d6 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:17.278515 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4c26077d-74b0-46a3-bd68-d508e9d0e8d6 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:17.408924 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-4c26077d-74b0-46a3-bd68-d508e9d0e8d6 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:17.416551 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4c26077d-74b0-46a3-bd68-d508e9d0e8d6 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a" status: 200 len: 1576 microversion: 2.1 time: 0.151979 May 10 21:37:17.417050 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 550/1103] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:37:17 2022] GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:37:18.056456 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [req-304bc7b6-049f-4b1d-a90b-bb045f75edbd req-d58670db-b4be-4166-a035-c841949d4151 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31927753-f8a8-4a62-8a56-c875a464157a", "name": "network-vif-deleted", "tag": "d86b5666-939c-498a-8aa7-42bf74c4eca2"}]} {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:37:18.064716 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-304bc7b6-049f-4b1d-a90b-bb045f75edbd req-d58670db-b4be-4166-a035-c841949d4151 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:18.065151 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [req-304bc7b6-049f-4b1d-a90b-bb045f75edbd req-d58670db-b4be-4166-a035-c841949d4151 service nova] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:18.076464 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.compute.server_external_events [req-304bc7b6-049f-4b1d-a90b-bb045f75edbd req-d58670db-b4be-4166-a035-c841949d4151 service nova] Creating event network-vif-deleted:d86b5666-939c-498a-8aa7-42bf74c4eca2 for instance 31927753-f8a8-4a62-8a56-c875a464157a on hv-cinder-83608 May 10 21:37:18.081314 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [req-304bc7b6-049f-4b1d-a90b-bb045f75edbd req-d58670db-b4be-4166-a035-c841949d4151 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029353 May 10 21:37:18.081923 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 554/1104] 10.222.0.25 () {64 vars in 1317 bytes} [Tue May 10 21:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:37:18.434664 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a5a50df4-be1f-4d50-8412-e3e968a39b35 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:18.435409 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-a5a50df4-be1f-4d50-8412-e3e968a39b35 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 31927753-f8a8-4a62-8a56-c875a464157a] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:18.442184 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a5a50df4-be1f-4d50-8412-e3e968a39b35 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:18.443386 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a5a50df4-be1f-4d50-8412-e3e968a39b35 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:18.445422 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a5a50df4-be1f-4d50-8412-e3e968a39b35 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:18.445856 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a5a50df4-be1f-4d50-8412-e3e968a39b35 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:18.511813 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-a5a50df4-be1f-4d50-8412-e3e968a39b35 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6802e5cde5bb48e2958124c88a7501d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6f673d1cfd41028e5ed60d4d204666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:18.519340 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-a5a50df4-be1f-4d50-8412-e3e968a39b35 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a" status: 200 len: 1224 microversion: 2.1 time: 0.089013 May 10 21:37:18.520022 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 551/1105] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:37:18 2022] GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:37:19.537836 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-8066483b-933c-4bea-8f95-feb6d974d3f8 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:19.538554 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-8066483b-933c-4bea-8f95-feb6d974d3f8 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: 31927753-f8a8-4a62-8a56-c875a464157a] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:19.544677 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8066483b-933c-4bea-8f95-feb6d974d3f8 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:19.545125 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8066483b-933c-4bea-8f95-feb6d974d3f8 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:19.545883 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8066483b-933c-4bea-8f95-feb6d974d3f8 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:19.546312 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-8066483b-933c-4bea-8f95-feb6d974d3f8 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:19.560056 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.wsgi [None req-8066483b-933c-4bea-8f95-feb6d974d3f8 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] HTTP exception thrown: Instance 31927753-f8a8-4a62-8a56-c875a464157a could not be found. May 10 21:37:19.561675 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-8066483b-933c-4bea-8f95-feb6d974d3f8 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Request method failure captured: May 10 21:37:19.561675 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: request: GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a HTTP/1.1 May 10 21:37:19.561675 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept: application/json May 10 21:37:19.561675 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept-Encoding: identity May 10 21:37:19.561675 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Connection: close May 10 21:37:19.561675 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Length: 0 May 10 21:37:19.561675 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Type: application/json May 10 21:37:19.561675 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Host: 10.222.0.25 May 10 21:37:19.561675 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Openstack-System-Scope: None May 10 21:37:19.561675 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: User-Agent: python-urllib3/1.26.9 May 10 21:37:19.561675 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Auth-Token: gAAAAABietlur2mue2fVt6UC9g-J2nXfoB7AjS6CXP5Qv4pKsFV_CVaO3GKhjDPbaI_mr5Xry7xIRr8s_qC7CypehsxS4AAjd_WGlOh7gKJN0R8M1AP06HezQpfdr0W8R9IECqdXhWttceAwRVPX8pSuXVFfkKOLXPXdO-pRhFtDciHV5K1dZCc May 10 21:37:19.561675 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Id: None May 10 21:37:19.561675 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Name: None May 10 21:37:19.561675 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Identity-Status: Confirmed May 10 21:37:19.561675 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Is-Admin-Project: True May 10 21:37:19.561675 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Id: default May 10 21:37:19.561675 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Name: Default May 10 21:37:19.561675 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Id: dd6f673d1cfd41028e5ed60d4d204666 May 10 21:37:19.561675 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Name: tempest-TestVolumeBootPattern-652640446 May 10 21:37:19.561675 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Role: member,reader May 10 21:37:19.561675 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Roles: member,reader May 10 21:37:19.563347 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dd6f673d1cfd41028e5ed60d4d204666"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_dd6f673d1cfd41028e5ed60d4d204666"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dd6f673d1cfd41028e5ed60d4d204666"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/dd6f673d1cfd41028e5ed60d4d204666"}]}] May 10 21:37:19.563347 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant: tempest-TestVolumeBootPattern-652640446 May 10 21:37:19.563347 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Id: dd6f673d1cfd41028e5ed60d4d204666 May 10 21:37:19.563347 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Name: tempest-TestVolumeBootPattern-652640446 May 10 21:37:19.563347 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User: tempest-TestVolumeBootPattern-652640446-project May 10 21:37:19.563347 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Id: default May 10 21:37:19.563347 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Name: Default May 10 21:37:19.563347 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Id: 6802e5cde5bb48e2958124c88a7501d9 May 10 21:37:19.563347 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Name: tempest-TestVolumeBootPattern-652640446-project May 10 21:37:19.563347 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: method: > May 10 21:37:19.563347 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: exception: Instance 31927753-f8a8-4a62-8a56-c875a464157a could not be found. May 10 21:37:19.563347 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: action_args: {'id': '31927753-f8a8-4a62-8a56-c875a464157a'} May 10 21:37:19.564415 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:37:19.564415 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:37:19.564415 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:37:19.564415 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:37:19.564415 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:37:19.564415 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:37:19.564415 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:37:19.564415 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:37:19.564415 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:37:19.564415 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:37:19.564415 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31927753-f8a8-4a62-8a56-c875a464157a could not be found. May 10 21:37:19.564415 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:37:19.564415 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:37:19.564415 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:37:19.564415 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:37:19.564415 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:37:19.564415 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:37:19.564415 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:37:19.564415 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:37:19.564415 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:37:19.566029 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:37:19.566029 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:37:19.566029 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:37:19.566029 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:37:19.566029 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:37:19.566029 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:37:19.566029 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:37:19.566029 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31927753-f8a8-4a62-8a56-c875a464157a could not be found. May 10 21:37:19.566029 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:37:19.566029 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:37:19.566029 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:37:19.566029 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:37:19.566029 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:37:19.566029 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:37:19.566029 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:37:19.566029 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:37:19.566029 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31927753-f8a8-4a62-8a56-c875a464157a could not be found. May 10 21:37:19.566029 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:37:19.567754 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-8066483b-933c-4bea-8f95-feb6d974d3f8 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Returning 404 to user: Instance 31927753-f8a8-4a62-8a56-c875a464157a could not be found. {{(pid=117678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:37:19.567754 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-8066483b-933c-4bea-8f95-feb6d974d3f8 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a" status: 404 len: 111 microversion: 2.1 time: 0.030473 May 10 21:37:19.567754 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 555/1106] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:37:19 2022] GET /compute/v2.1/servers/31927753-f8a8-4a62-8a56-c875a464157a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:37:20.089351 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-c78f6b6f-1755-4b2b-981e-9f7f3acadf71 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:20.089836 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-c78f6b6f-1755-4b2b-981e-9f7f3acadf71 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: d9e4cb99-8342-478c-962e-8b22f512072d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:20.096126 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c78f6b6f-1755-4b2b-981e-9f7f3acadf71 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:20.096587 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c78f6b6f-1755-4b2b-981e-9f7f3acadf71 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:20.097343 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c78f6b6f-1755-4b2b-981e-9f7f3acadf71 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:20.097776 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c78f6b6f-1755-4b2b-981e-9f7f3acadf71 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:20.111789 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-c78f6b6f-1755-4b2b-981e-9f7f3acadf71 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] HTTP exception thrown: Instance d9e4cb99-8342-478c-962e-8b22f512072d could not be found. May 10 21:37:20.113445 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-c78f6b6f-1755-4b2b-981e-9f7f3acadf71 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Request method failure captured: May 10 21:37:20.113445 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: request: DELETE /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d HTTP/1.1 May 10 21:37:20.113445 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept: application/json May 10 21:37:20.113445 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity May 10 21:37:20.113445 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Connection: close May 10 21:37:20.113445 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Length: 0 May 10 21:37:20.113445 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Content-Type: application/json May 10 21:37:20.113445 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Host: 10.222.0.25 May 10 21:37:20.113445 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None May 10 21:37:20.113445 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 May 10 21:37:20.113445 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABietlur2mue2fVt6UC9g-J2nXfoB7AjS6CXP5Qv4pKsFV_CVaO3GKhjDPbaI_mr5Xry7xIRr8s_qC7CypehsxS4AAjd_WGlOh7gKJN0R8M1AP06HezQpfdr0W8R9IECqdXhWttceAwRVPX8pSuXVFfkKOLXPXdO-pRhFtDciHV5K1dZCc May 10 21:37:20.113445 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Id: None May 10 21:37:20.113445 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Domain-Name: None May 10 21:37:20.113445 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed May 10 21:37:20.113445 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True May 10 21:37:20.113445 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default May 10 21:37:20.113445 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default May 10 21:37:20.113445 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Id: dd6f673d1cfd41028e5ed60d4d204666 May 10 21:37:20.113445 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-TestVolumeBootPattern-652640446 May 10 21:37:20.113445 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Role: member,reader May 10 21:37:20.113445 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Roles: member,reader May 10 21:37:20.115642 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dd6f673d1cfd41028e5ed60d4d204666"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_dd6f673d1cfd41028e5ed60d4d204666"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dd6f673d1cfd41028e5ed60d4d204666"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/dd6f673d1cfd41028e5ed60d4d204666"}]}] May 10 21:37:20.115642 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-TestVolumeBootPattern-652640446 May 10 21:37:20.115642 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Id: dd6f673d1cfd41028e5ed60d4d204666 May 10 21:37:20.115642 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-TestVolumeBootPattern-652640446 May 10 21:37:20.115642 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User: tempest-TestVolumeBootPattern-652640446-project May 10 21:37:20.115642 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default May 10 21:37:20.115642 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default May 10 21:37:20.115642 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Id: 6802e5cde5bb48e2958124c88a7501d9 May 10 21:37:20.115642 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-TestVolumeBootPattern-652640446-project May 10 21:37:20.115642 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: method: > May 10 21:37:20.115642 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: exception: Instance d9e4cb99-8342-478c-962e-8b22f512072d could not be found. May 10 21:37:20.115642 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: action_args: {'id': 'd9e4cb99-8342-478c-962e-8b22f512072d'} May 10 21:37:20.116582 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:37:20.116582 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:37:20.116582 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:37:20.116582 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:37:20.116582 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:37:20.116582 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:37:20.116582 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:37:20.116582 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:37:20.116582 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:37:20.116582 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:37:20.116582 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9e4cb99-8342-478c-962e-8b22f512072d could not be found. May 10 21:37:20.116582 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:37:20.116582 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:37:20.116582 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:37:20.116582 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:37:20.116582 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:37:20.116582 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:37:20.116582 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:37:20.116582 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:37:20.116582 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:37:20.118108 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:37:20.118108 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 21:37:20.118108 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 21:37:20.118108 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 21:37:20.118108 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 21:37:20.118108 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:37:20.118108 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:37:20.118108 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:37:20.118108 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:37:20.118108 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9e4cb99-8342-478c-962e-8b22f512072d could not be found. May 10 21:37:20.118108 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:37:20.118108 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:37:20.118108 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:37:20.118108 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:37:20.118108 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:37:20.118108 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:37:20.118108 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:37:20.118108 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:37:20.118108 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9e4cb99-8342-478c-962e-8b22f512072d could not be found. May 10 21:37:20.118108 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi May 10 21:37:20.119883 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-c78f6b6f-1755-4b2b-981e-9f7f3acadf71 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Returning 404 to user: Instance d9e4cb99-8342-478c-962e-8b22f512072d could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:37:20.119883 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-c78f6b6f-1755-4b2b-981e-9f7f3acadf71 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d" status: 404 len: 111 microversion: 2.1 time: 0.030400 May 10 21:37:20.119883 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 552/1107] 10.222.0.25 () {58 vars in 1238 bytes} [Tue May 10 21:37:20 2022] DELETE /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:37:20.124446 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-a09d7ff7-72a8-42aa-9062-3fa98942146f tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '>' {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:20.125329 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.compute.api [None req-a09d7ff7-72a8-42aa-9062-3fa98942146f tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] [instance: d9e4cb99-8342-478c-962e-8b22f512072d] Fetching instance by UUID {{(pid=117678) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:20.131915 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-a09d7ff7-72a8-42aa-9062-3fa98942146f tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:20.132365 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-a09d7ff7-72a8-42aa-9062-3fa98942146f tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:20.133129 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-a09d7ff7-72a8-42aa-9062-3fa98942146f tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:20.133564 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG oslo_concurrency.lockutils [None req-a09d7ff7-72a8-42aa-9062-3fa98942146f tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Lock "618a26cc-a7ee-4518-9a96-cde8a6bd82c4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:20.147077 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.wsgi [None req-a09d7ff7-72a8-42aa-9062-3fa98942146f tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] HTTP exception thrown: Instance d9e4cb99-8342-478c-962e-8b22f512072d could not be found. May 10 21:37:20.148582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-a09d7ff7-72a8-42aa-9062-3fa98942146f tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Request method failure captured: May 10 21:37:20.148582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: request: GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d HTTP/1.1 May 10 21:37:20.148582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept: application/json May 10 21:37:20.148582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Accept-Encoding: identity May 10 21:37:20.148582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Connection: close May 10 21:37:20.148582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Length: 0 May 10 21:37:20.148582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Content-Type: application/json May 10 21:37:20.148582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Host: 10.222.0.25 May 10 21:37:20.148582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Openstack-System-Scope: None May 10 21:37:20.148582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: User-Agent: python-urllib3/1.26.9 May 10 21:37:20.148582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Auth-Token: gAAAAABietlur2mue2fVt6UC9g-J2nXfoB7AjS6CXP5Qv4pKsFV_CVaO3GKhjDPbaI_mr5Xry7xIRr8s_qC7CypehsxS4AAjd_WGlOh7gKJN0R8M1AP06HezQpfdr0W8R9IECqdXhWttceAwRVPX8pSuXVFfkKOLXPXdO-pRhFtDciHV5K1dZCc May 10 21:37:20.148582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Id: None May 10 21:37:20.148582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Domain-Name: None May 10 21:37:20.148582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Identity-Status: Confirmed May 10 21:37:20.148582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Is-Admin-Project: True May 10 21:37:20.148582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Id: default May 10 21:37:20.148582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Domain-Name: Default May 10 21:37:20.148582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Id: dd6f673d1cfd41028e5ed60d4d204666 May 10 21:37:20.148582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Project-Name: tempest-TestVolumeBootPattern-652640446 May 10 21:37:20.148582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Role: member,reader May 10 21:37:20.148582 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Roles: member,reader May 10 21:37:20.150197 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dd6f673d1cfd41028e5ed60d4d204666"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_dd6f673d1cfd41028e5ed60d4d204666"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dd6f673d1cfd41028e5ed60d4d204666"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/dd6f673d1cfd41028e5ed60d4d204666"}]}] May 10 21:37:20.150197 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant: tempest-TestVolumeBootPattern-652640446 May 10 21:37:20.150197 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Id: dd6f673d1cfd41028e5ed60d4d204666 May 10 21:37:20.150197 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-Tenant-Name: tempest-TestVolumeBootPattern-652640446 May 10 21:37:20.150197 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User: tempest-TestVolumeBootPattern-652640446-project May 10 21:37:20.150197 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Id: default May 10 21:37:20.150197 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Domain-Name: Default May 10 21:37:20.150197 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Id: 6802e5cde5bb48e2958124c88a7501d9 May 10 21:37:20.150197 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: X-User-Name: tempest-TestVolumeBootPattern-652640446-project May 10 21:37:20.150197 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: method: > May 10 21:37:20.150197 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: exception: Instance d9e4cb99-8342-478c-962e-8b22f512072d could not be found. May 10 21:37:20.150197 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: action_args: {'id': 'd9e4cb99-8342-478c-962e-8b22f512072d'} May 10 21:37:20.151148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: {{(pid=117678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:37:20.151148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:37:20.151148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:37:20.151148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:37:20.151148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:37:20.151148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:37:20.151148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:37:20.151148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:37:20.151148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:37:20.151148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:37:20.151148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9e4cb99-8342-478c-962e-8b22f512072d could not be found. May 10 21:37:20.151148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:37:20.151148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:37:20.151148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:37:20.151148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:37:20.151148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:37:20.151148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:37:20.151148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:37:20.151148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:37:20.151148 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:37:20.152694 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:37:20.152694 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:37:20.152694 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:37:20.152694 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:37:20.152694 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:37:20.152694 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:37:20.152694 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:37:20.152694 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9e4cb99-8342-478c-962e-8b22f512072d could not be found. May 10 21:37:20.152694 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:37:20.152694 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:37:20.152694 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:37:20.152694 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:37:20.152694 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:37:20.152694 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:37:20.152694 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:37:20.152694 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:37:20.152694 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9e4cb99-8342-478c-962e-8b22f512072d could not be found. May 10 21:37:20.152694 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: ERROR nova.api.openstack.wsgi May 10 21:37:20.154104 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: DEBUG nova.api.openstack.wsgi [None req-a09d7ff7-72a8-42aa-9062-3fa98942146f tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Returning 404 to user: Instance d9e4cb99-8342-478c-962e-8b22f512072d could not be found. {{(pid=117678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:37:20.154104 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO nova.api.openstack.requestlog [None req-a09d7ff7-72a8-42aa-9062-3fa98942146f tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d" status: 404 len: 111 microversion: 2.1 time: 0.029283 May 10 21:37:20.154104 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: [pid: 117678|app: 0|req: 556/1108] 10.222.0.25 () {58 vars in 1235 bytes} [Tue May 10 21:37:20 2022] GET /compute/v2.1/servers/d9e4cb99-8342-478c-962e-8b22f512072d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:37:21.612642 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-de619938-1e1a-4cd7-a8fa-eb12f93224b1 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] Calling method '.version_select at 0x7f7aef5b4ca0>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:21.713336 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-de619938-1e1a-4cd7-a8fa-eb12f93224b1 tempest-TestVolumeBootPattern-652640446 tempest-TestVolumeBootPattern-652640446-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-548372847" status: 202 len: 0 microversion: 2.1 time: 0.104503 May 10 21:37:21.713910 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 553/1109] 10.222.0.25 () {58 vars in 1259 bytes} [Tue May 10 21:37:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-548372847 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 21:38:35.737288 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 21:38:35.737980 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Tue May 10 21:38:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 21:38:45.351056 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 21:38:45.351533 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Tue May 10 21:38:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 21:40:29.983938 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 21:40:29.984539 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Tue May 10 21:40:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 21:40:35.796376 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 21:40:35.797065 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Tue May 10 21:40:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 21:40:37.973007 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 21:40:37.973517 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Tue May 10 21:40:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 21:41:55.745755 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 21:41:55.746329 dv-cinder-836083-6-iscsi devstack@n-api.service[117679]: Tue May 10 21:41:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 21:42:05.360293 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 21:42:05.360775 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Tue May 10 21:42:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 21:42:28.389421 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 21:42:28.390076 dv-cinder-836083-6-iscsi devstack@n-api.service[117678]: Tue May 10 21:42:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!